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SYNOPSIS 


The minimum cost flow problem has been receiving continuous 
intensive research for last five decades due to its wide 
applications in areas such as operations research, applied 
mathematics, computer science and other related areas. In this 
dissertation, our contributions to this area of research are two 
fold : (i) developing new primal algorithms, (ii) studying the 
effects of cost perturbations. 

We first study the primal network simplex algorithm with a 
new entering arc rule, which we call as the minimum ratio pivot 
rule. This rule assigns a unit penal “t:y to each arc violating 
optimal'^y conditions in the initial basis . Then every pivot 
iteration selects a nonbasic arc whose fundamental cycle has the 
minimum cost-to-penality ratio as the entering arc. The algorithm 
performs at most n consecutive degenerate pivots and runs in 
pseudo -polynomial time. When applied to the shortest path problem 
and the assignment problem, the algorithm runs in 0(nm + n log n) 
time. Here n denotes the number of nodes and m denote the number 
of arcs in the given network. 

We next develop two cycle cancelling algorithms. Our first 
cycle cancelling algorithm repeatedly selects an eligible arc 
(that is, violating its optimality conditions) with the largest 
residual capacity. Then either the selected arc is made 
noneligible, or its residual capacity is reduced to half of its 
previous capacity by augmenting flow along a negative cycle. When 



arc capacities are integers, the algorithm runs in 0{m log U {m + n 
log n) ) , where U denotes the largest capacity over all arcs. 

Our second cycle" cancelling algorithm performs the following 

steps repeatedly on the residual network. The subgraph of the 

residual graph consisting of eligible arcs is made acyclic. Then 

a cut with noneligible forward arcs and atleast one eligible 

backward arc is found; the maximum optimality violation over the 

arcs in this cut is brought down. When arc costs are integral, 

the algorithm runs in 0(nm log n log (nC)), where C is the largest 

cost over all arcs. Incorporating a shortest path subroutine in 

the iterative procedure, we make the algorithm strongly 

polynomial. The strongly polynomial version of this algorithm 
2 2 

runs in 0{nm (log n) ) time. 

We next consider the arc tolerance analysis for the separable 
convex cost flow problem. Here we consider the problem of 
perturbing cost function associated with an arc while maintaining 
optimality of a given flow. For an arc {k, 1) , we define arc 
tolerance interval as the interval having the property 

that any cost function having at least one of its left and right 
derivative in the interval maintains the optimality of the given 
flow. We characterize and in terras of nonsingleton 

shortest distances between node k and node t in the residual 
network. For the minimum cost flow problem, this is the interval 
in which the cost co-efficient can vary while maintaining the 
optimality of the given flow. We give an O(n^) algorithm to 
compute tolerance intervals for all arcs in the network. 

We next consider inverse network flow problems. Given an 
observed flow and a priori estimated cost c, the inverse network 
flow problem is to perturb c to a "nearest" cost t for which the 



given flow becomes a minimum cost flow. We call such a vector t 
as a conormal at the given flow and we measure the "nearness" by a 
variance function k{t-c) , where k is the function having all 
properties of a norm except for symmetry. Using duality results 
in convex analysis, we develop the theory for duality in the 
general context where the observed solution is a solution to a 
system of linear constraints and the "nearness" is measured by a 
general variance function fc(t-c) . We show the following results 
for inverse network flow problems. 

(i) The dual of Euclidean inverse network flow problem is 
equivalent to a separable strictly convex quadratic cost flow 
problem. The optimal solutions of the primal and dual problems 
give a decomposition of the given cost c. 

(ii) The dual of weighted rectilinear inverse network flow 
problem is a minimum cost flow problem. A minimum cost disjoint 
augmenting cycles with respect to the given flow is an optimum 
solution to the dual of the rectilinear inverse network flow 
problem . 

(iii) The dual of the weighted maximum inverse network flow 
problem is equivalent to finding a minimum cost-to-weight ratio 
augmenting cycle with respect to the given flow. 

(iv) The dual of the weighted rectilinear inverse spanning tree 
problem is transformed to a transportation problem. 

We also construct an optimal solution to the corresponding 
inverse network flow problems from the information obtained in 
solving the respective dual problems. 
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Chapter 1 


INTRODUCTION 


1.1 INTRODUCTION 

Highways, telephone lines, electric power systems, computer 
chips, water delivery system, and rail lines; these physical 
networks and many others, are familiar to all of us. In each of 
these problem settings, the minimum cost flow problem arises 
naturally and plays a pivotal role. The problem is that we wish 
to send some, good(s) (vehicles, messages, electricity, or water) 
from source (s) to destination (s) in a network at minimum possible 
cost. Networks are also used to represent logical relationships 
in important practical problems. As a result, the minimum cost 
flow problem solves a wide variety of applications arising in 
facility location, production planning, project management, 
operations scheduling and cash management, apart from obvious 
transportation and communication applications in physical networks 
(see Ahuja et al* [1993] and references therein) . 

Researchers have proposed many algorithms to solve the 
minimum cost flow problem. Most of the fundamental algorithms 
such as the primal network simplex algorithm, the primal -dual 
algorithm, the successive shortest path algorithm, the out-of- 
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kilter algorithm and the cycle -canceling algorithm were developed 
in 1950s and 1960s. The development of the first polynomial 
algorithm by Edmonds and Karp [1972] and the first strongly 
polynomial algorithm by Tardos [1985] have created interest in 
developing polynomial and strongly polynomial versions of 
traditional algorithms. Researchers also studied theoretical 
behaviour such as degeneracy, cycling, and stalling in the primal 
network simplex algorithm due to its theoretical and practical 
importance . 

Perturbations of arc costs that preserve optimality is a 
well-known problem under post -optimality analysis. The so-called 
basis preserving cost operator theory by Srinivasan and Thompson 
[1972] and tolerance analysis by Shier and Witzgall [1980] 
consider this issue for an optimal basis (spanning tree structure) 
obtained by a primal network simplex algorithm. Recently, Burton 
and Toint [1992, 1994] have studied cost perturbations that make a 
given solution optimal in the context of shortest paths. Their 
problem, called as inverse shortest path problem, is to perturb 
arc costs such that given set of paths become shortest paths after 

perturbations, and the perturbation is minimum with respect to the 
Euclidean norm. 

In this dissertation, we investigate the following algorithms 
and problems: 

) The primal network simplex algorithm with a new entering arc 
rule. 

li) TWO variants of oyoie-canoeling algorithms, 
nil Arc tolerances with respect to an optimal flow for the more 
general separable convex cost flow problem. 



iv) The inverse network flow problem, 
v) The inverse spanning tree problem. 

The proposed primal network simplex algorithm assigns unit 
penalty to each arc violating its optimality condition in the 
initial basis. At each iteration, an arc with the minimum 
cost-to-penalty ratio is selected as an entering arc. We analyze 
the anti-stalling property and overall complexity in the 
worst-case sense. The complexity of the algorithm for the special 
cases, the shortest path and assignment problem is analyzed. We 
next propose two variants of the cycle-canceling algorithm. The 
first algorithm uses the idea of capacity scaling. The second 
algorithm reduces the maximum optimality violation in a cut at 
least by a factor of two. The second variant becomes strongly 
polynomial when it is enhanced by a shortest path subroutine. 

We next study arc tolerances with respect to an optimal flow 
instead of an optimal basis. We develop the theory for the more 
general separable convex cost flow model by properly defining arc 
tolerances . We characterize arc tolerances by nonsingleton 
shortest paths between the head and tail nodes of the 
corresponding arc , We then develop an algorithm to compute 
tolerance intervals for all arcs which essentially computes 
nonsingleton shortest paths between all pair of nodes. 

We next study the inverse network flow problem. The problem 
is to perturb a priori estimated set of arc costs such that a 
given feasible flow becomes a minimum cost flow and the 
perturbation is minimum with respect to a norm like function. We 
first derive the dual of inverse linear programming problem from 
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the duality results for convex programming. We show that duals of 
the inverse network flow problems in which perturbations are 
measured by the Euclidean, the weighted rectilinear, and the 
weighted maximum variances are, respectively, equivalent to 
solving standard problems, namely, the separable strictly convex 
quadratic flow problem, the minimum cost circulation problem, and 
the minimum cost-to-weight ratio problem. We also show that the 
dual of the weighted rectilinear inverse flow problem is a 
transportation problem. 

1 . 2 PRELIMINARIES 

In this section we give basic definitions from graph theory 
and complexity theory and formulations of the minimum cost flow 
problems and other related formulations. 

1.2.1 Graph Theoretical Notations and Definitions 

A directed graph G = (ff. A) consists of a set N of nodes and 
a set A of arcs whose elements are ordered pairs of distinct 

nodes. A directed network is a directed graph whose nodes and/or 
arcs have associated numerical values (typically, costs, 
capacities, and/or supplies and demands) . We often make no 

^^®binction between graphs and networks, so we use the terms 
graph and ’’networks” synonymously. We let n denote the number 
of nodes and m denote the number of arcs in G. An undirected 
9^®P^/^®twork is defined in the same way as a directed graph/ 
network except that arcs are unordered pairs of distinct nodes. A 
directed arc (i, j) has two endpoints i and j. We refer to node i 
as the tail of the arc (i, J) and node j as its head. We say that 

the arc (i, J) emanates from node i and terminates 


at node j. An 



arc (i, j) is incident to nodes i and j. An arc (i, j) is an 

outgoing arc of node i and an incoming arc of node j. The forvard 

star F{i) of node i is the set of arcs emanating from node i and 

the backward star B{i) is the set of arcs terminating at node i. 

The forward star F(i) and the backward star B(i) are also used to 

refer to the head nodes of outgoing arcs at node i and the tail 

nodes of incoming arcs at node j. We let A{i) denote the set of 

all outgoing and incoming arcs at node i. Note that Y lF(i) I = 

i€N 

5^ |B(i) I = m, and lA{i) | = 2jn. We assume that no arc has the 
UN ieN 

same node as its head and tail, and no two or more arcs have the 
same tail and head nodes. That is, there are no loops and 
multiarcs. A graph G'= {N' , A') is a subgraph of G = {N,A) if N' s 
N and A’ £ A. 

A valk in a directed graph G = (iff. A) is a subgraph of G 
consisting of a sequence of nodes and arcs i^-a^-i^-a^- . . . 

i^_^-a^_^-i^ satisfying the property that for all 1 s k s r-1, 
either = (i^, e A or = ^^k+1' ^k^ e A. We shall 

sometimes omit arcs or nodes in the representation of a walk. A 
directed walk is a walk in which every two consecutive nodes ij^ 
and connected by the arc (i^, ^ path is a walk 

without any repetition of nodes. A cycle is a path i^-i^-...-i^ 
together with the arc (i^, i^) or (i^, i^) . We shall often refer 
to a cycle using the notation ••• 

a path/cycle is a forvard arc if the path/cycle visits node i 
priori to visiting node j, and is a backvard arc otherwise. The 
set of forward arcs and the set of backward arcs of a path P 
(cycle W) are denoted respectively by P{W) and P(W) . We say 
orientation of a cycle is same as that of an arc (i, j) in the 



cycle if (i, j) is a forward arc in the cycle, and is opposite to 
that of arc (i, j) if it is a backward arc in the cycle. A 
directed path/cycle is a path/cycle in which every arc is a 
forward arc. 

A graph is acyclic if it contains no directed cycle. We will 
say that two nodes i and j are connected if the graph contains at 
least one path from node i to node j. A graph is connected if 
every pair of its nodes is connected; otherwise, the graph is 
disconnected. We assume that the graphs considered in this thesis 
are connected. 

A cut is a partition of the node set N into two parts, S and 
S = N-S, where S is a non-empty proper subset of N. Each cut 
defines a set of arcs consisting of those arcs that have one end 
point in S and another point in S. Therefore, we refer to this 
set of arcs as a cut and represent it by the notation [S, S] . An 
arc (i, J) is a forirard arc of the cut [S, S] if i € S and J e S, 
and is a backward arc if i e S and jf e S, We denote the set of 
forward arcs in [S, S] by (S, S) , and the set of backward arcs by 
(S, S) . An s-t cut is defined with respect to two distinguished 
nodes s and t and is a cut [S, S] satisfying the property that s e 
S and t e S. 

A tree is a connected graph that contains no cycle . A 
connected subgraph of a tree is a subtree. A rooted tree is a 
tree with a specially designated node, called its root; we regard 
a rooted tree as though it were hanging from its root. A tree is 
a directed out -tree rooted at node s if the unique path in the 
tree from node s to every other node is a directed path. 



A tree T is a spanning tree of G if T contains all nodes of 
G. We refer to the arc belonging to a spanning tree T as tree 
arcs and arcs not belonging to T as nontree arcs. The addition of 
any nontree arc to the spanning tree T creates exactly one cycle. 
We refer to any such cycle as a fundamental cycle of G with 
respect to the tree T. Since a basis of the minimum cost flow 
problem corresponds to a spanning tree T, tree arcs, nontree arcs 
and fundamental cycles are also alternatively referred to as basic 
arcs, nonbasic arcs and basic cycles respectively. The deletion 
of any tree arc (i, j) of the spanning tree T produces a 
disconnected graph containing two subtrees containing node i 
and Tj containing node J. This also produces an i-J cut whose 
node partition is given by nodes in and Ty We sometimes 
denote this cut by [S_., Sj] where S_. and Sj are respectively the 
nodes spanning the trees and Tj. 

A graph G = {N, A) is a bipartite graph if we can partition 
its node set into two subsets and ^2 so that for each arc (i, 
j) in A either (i) i ® snd j ^ ^ 2 ' ® ^2 ^ ^1' 

1.2.2 Minimum Cost Flow Problem 

We now present a mathematical programming formulation of the 
minimum cost flow problem (MCF) and then describe several of its 
specializations and variants as well as the separable convex cost 
flow problem that we consider in this thesis. 

Let G = iN, -A) be a directed network defined by a set N of n 
nodes and a set A of m directed arcs. Each arc (i, j) e A has an 
associated cost c^. that denotes the cost per unit flow on that 
arc. We assume that the flow cost varies linearly with the amount 



of flow. We also associate with each arc (i, j) e .A a capacity 


u^j (also called as upper bound) that denotes the maximum amount 
that can flow on the arc and a lover bound that denotes the 
minimum amount that must flow on the arc. We associate with each 
node i e N an integer number jb(i) representing its supply /demand . 
If 2?(i) >0, node i is a supply node; if b{i) < 0, node i is a 
demand node; if b{i) = 0, node i is a transshipment node. The 
decision variables in the minimum cost flow problem are arc flovs 
and we represent the flow on arc (i, j) e A hy x^j. The minimum 
cost flow problem is an optimization model formulated as follows: 

Minimize y. <=;; (1.1a) 

(i,j)€A 

subject to 

■ f ^ ,^7i = i e N (1.1b) 


‘ij " *ij = “ij 


n 


where y b{i) = o. In matrix form, 
i=l 


for all (i, j) e a, (1.1c) 
we represent the minimum cost 


flow problem as follows : 
Minimize cx 
subject to 

J>fx = b, 

I s X s u. 


(1.2a) 

(1.2b) 

(1.2c) 


In this formulation, is an nxm matrix, called the node-arc 
incidence matrix of the minimum cost flow problem. Each column 
in the matrix corresponds to the variable Xj. . . The column . . 

has a +1 in the i^^ row, a -l in the row; the rest of its 

entries are zero . 



We refer to the constraints in (l.lb) as flov conservation 
equations. The flow must also satisfy the lower bound and 
capacity constraints (1.1c), which we refer to as flov bound 
constraints. We refer to both (l.lb) and (l.lc) as the system of 
flov constraints on G and denote it by F. We often assume all 
lower bounds are zero; if we do not state lower bounds for any 
problem, we assume that they have value zero. 

We consider the following special cases of the minimum cost 
flow problem in the thesis. 

Shortest path problem : The problem is to find a path of 
minimum cost (or length) from a specified source node s to another 
specified sink node t, assuming that each arc (i, j) e A has an 
associated cost (or length) c^j. If we set bis) = 1, Jb(t) = -1, 
and Jb(i) =0 for all other nodes in the minimum cost flow problem, 
the solution to the problem will send 1 unit of flow from node s 
to node t along shortest path. If we want to determine shortest 
paths from source node s to every other node in the network, then 
in the minimum cost flow problem we set bis) = (n-1) and Jb(i) = -1 
for all other nodes. [We can set each arc capacity u^j to any 
number larger than (n-1)]. The minimum cost flow solution would 
then send unit flow from node s to every other node i along a 
shortest path. Both versions of the problem essentially find a 
directed out-tree rooted at node s in which the tree path from 
node s to every other node is a shortest path; we refer to this 
tree as a shortest path tree from node s. In linear programming 
terminology, this corresponds to an optimum basic solution of the 
problem. 


Q 



The data of the assignment problem 


Assignment problem : 
consist of two equally sized sets and (i.e., IW^I = 1 ^ 2 !)' ^ 
collection of pairs A z x representing possible alignments, 
and a cost c^j associated with each element (i, j) e A. In the 
assignment problem we wish to pair, at minimum possible cost, each 
object in with exactly one object in The assignment 

problem is a minimum cost flow problem in a network G = {N^uN^, A) 
with l>(i) = 1 for all i e N^, b(i) = -1 for all i e N^, and = 

1 for (i, j) e A. 

Transportation problem : The transportation problem is a 

special case of the minimum cost flow problem with the property 
that the node set N is partitioned into two subsets and (of 
possibly unequal cardinality) so that (1) each node in is a 
supply node, (2) each node is a demand node, and (3) for each 
arc {i, j) in A, is and j ^ 

Circulation problem : The circulation problem is a minimum 
cost flow problem with only transshipment nodes; that is, b(i) = 0 
for all i € N. In this instance, we wish to find a feasible flow 
that honours the lower and upper bounds t. . and u. . imposed on the 
arc flow Since we never introduce any exogenous flow into 

the network or extract any flow from it, all the flow circulates 

around the network. We wish to find the circulation that has the 
minimum cost. 

In this thesis, the separable convex cost flow problem 
(SC5CF) , a generalization of the minimum cost flow is considered 
for arc tolerance analysis. 



Separable convex cost flow problem : In this model, the cost 
of an arc flow is a convex function of the amount of flow on the 
arc. That is, the objective (l.la) is replaced by the following 
convex cost function : 


C{x) 


I 




(1.3) 


where is a real-valued convex function of the amount of 

flow 


An inverse problem of the following minimum spanning tree 
problem is considered in the thesis. 


Minimiim spanning tree problem : The cost of a spanning tree 
of an undirected graph is the sum of the costs (or lengths) of its 
arcs. In the minimum spanning tree problem, we wish to identify a 
spanning tree of minimum cost (or length) . 

1.2.3 Complexity Analysis 

We measure the performance of algorithms in the worst -case 
sense. Worst-case analysis aims to provide upper bounds on the 
number of steps that a given algorithm can take on any problem 
instance. For a worst-case analysis, we bound the running time of 
network algorithms in terms of several basic problem parameters, 
the number n of nodes, the number m of arcs, and upper bounds C 
and U on the cost coefficients and the arc capacities. Whenever C 
(or U) appears in the complexity analysis, we assume that each 
cost (or capacity) is integer valued. To express the running 
times, we rely extensively on 0{ ) notations. For example, we 
write that Dijkstra's shortest path algorithm runs in 0(in+n log n) 
time. This means that if we count the number of arithmetic steps 
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taken by the algorithm, then the number of steps taken by any 
instance s c{itt+n log n) for some constant c; the constant c does 
not depend on the parameters of the problem. 

An algorithm is said to be a polynomial time algorithm if its 
running time is bounded by a polynomial function of the input 
length. The input length of a problem is the number of bits 
needed to represent it. For a network problem, the input length 
is a low-order polynomial function of n, m, log C and log 17. 
Consequently, a network algorithm is a polynomial time algorithm 
if its running time is bounded by a polynomial function of n, m, 
log C and log U. A polynomial time algorithm is said to be a 
strongly polynomial time algorithm if its running time is bounded 
by a polynomial function in only n and m. We say that an 
algorithm is a pseudo-polynomial time algorithm if its running 
time is polynomially bounded in n, m, C, and U. 

The study of network flow models predates the development of 
linear programming. The first studies in this domain, conducted 
by Kantorovich [1939] , Hitchcock [1941] , and Koopmans [1947] , 
considered the transportation problem, a special case of the 
minimum cost flow problem. These studies provided insight into 
the problem structure and yielded algorithmic approaches. 
Interest in the network flow problems grew with the advent of the 
simplex method by Dantzig in 1947, who also specialized this 
algorithm for the transportation problem (see Dantzig [1951] ) . 

During the 1950s, researchers began to exhibit increasing 
interest in the minimum cost flow problem and its specializations 
mainly because of the importance of these models in real-world 



applications. Dantzig, Ford, and Fulkerson pioneered the 

development of special algorithms for solving these problems. 
Whereas Dantzig focused on the simplex based methods. Ford and 
Fulkerson developed primal-dual combinatorial algorithms. The 
landmark books by Dantzig [1962] and Ford and Fulkerson [1962] 
present thorough discussion of these early contributions - 

The following are some important algorithmic approaches 
developed for solving the minimum cost flow problem. 

1. Primal network simplex algorithm (Dantzig [1951, 1962]). 

2. Primal-dual algorithm (Ford and Fulkerson [1957, 1962]). 

3 . Successive shortest path algorithm (Jewell [1958] , Iri 

[1960] , Busaker and Gowen [1961] ) . 

4. Out-of -kilter algorithm (Minty [1960], Fulkerson [1961]). 

5. Cycle-cancelling algorithm (Klein [1967]). 

6. Relaxation algorithm (Bertsekas and Tseng [1988]). 

Primal network simplex algorithm and Relaxation algorithm are 
found to be efficient in practice. 

The capacity scaling algorithm by Edmonds and Karp [1972] 
pioneered the development of polynomial algorithms for the minimum 
cost flow problem. Rock [1980] and, independently. Bland and 

Jensen [1985] suggested a cost scaling technique. The capacity 
scaling and the cost scaling techniques are further refined by 
Orlin [1984] and Goldberg and Tarjan [1987] . The first strongly 
polynomial time algorithm for the minimum cost flow problem is 
proposed by Tardos [1985] . Her idea of "fixing arc flows" and 
Orlin [1984, 1988] idea of "fixing node potentials" played 
important role in the development of strongly polynomial 
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algorithms. Fujishige [1986], Galil and Tardos [1986], Goldberg 
and Tar j an [1988] , Erlovina and McCormick [1990] , and Gabow and 
Tarjan [1989] made contributions in this field. Orlin [1984] and 
Plotkin and Tardos [1990] have developed polynomial -time dual 
network simplex algorithms. Very recently, Orlin [1995] settled 
the question of developing polynomial primal network simplex 
algorithm positively by developing one such algorithm. 

The best available time bound for the minimum cost flow 
problem is 0(min {im log(n^/jn) log (nC), ran (loglogU) log (nC) , 
m log n (in+n log n) } . These bounds are obtained, respectively, by 
Goldberg and Tarjan [1987], Ahuja, Goldberg, Orlin, and Tarjan 
[1992] , and Orlin [1988] . 

The bibliographies on network optimization prepared by Golden 
and Magnanti [1977], Ahuja, Magnanti, and Orlin [1989, 1991], 
Bazaraa, Jarvis, and Sherali [1990] , and the extensive set of 
references on integer programming compiled by researchers at the 
University of Bonn (Kartning [1976] , Hausman [1978] , and Von 
Randow [1982, 1985] ) provide good references on the developments 
in network optimization. Some survey papers on applications of 
network optimization are Bennington [1974] , Glover and Klingman 
[1977], Glover, Klingman and Phillips [1990], and Ahuja, Magnanti, 
Orlin and Reddy [1995] . The book by Ahuja, Magnanti and Orlin 
[1993], and the survey paper by Ahuja et al. [1995] describe more 
than 100 applications and provide additional references to many 
more applications. 

1.3 OUTLINE OF THE THESIS 

In Chapter 2, we present a variant of the primal network 
sin 5 )lex algorithm, with a new entering arc rule, which we call as 



the minimum ratio pivot rule. This rule assigns unit penalty to 
each arc violating optimality conditions in the initial basis. We 
define the penalty of a fundamental cycle created by a nonbasic 
arc in the same way as the cost is defined. Then every pivot 
iteration selects a nonbasic eligible arc whose fundamental cycle 
has the minimum cost-to-penalty ratio. We maintain a strongly 
feasible basis (Cunningham [1976] ) throughout the execution of the 
algorithm. Cunningham [1979] and Goldfaird, Hao and Kai [1990b] 
proposed several antistalling pivot rules for the network simplex 
algorithm which prevent exponential number of consecutive 
degenerate pivots. Our rule is also an antistalling pivot rule 
which allows at most n consecutive degenerate pivots. Though our 
algorithm is pseudo-polynomial, our algorithm runs in 0{nin + n 
log n) time for the shortest path problem and the assignment 
problem; this complexity matches the complexity of best 
implementations of the network simplex algorithms for these 
problems developed by Glover and Klingman [1988] , and Akgul [1985, 
1994] . Our implementation and analysis is simpler. 

In Chapter 3 , we develop two variants of the cycle-cancelling 
algorithm. The cycle-cancelling algorithm is credited to Klein 
[1967] . Goldberg and Tarjan [1988] , Barhona and Tardon [1989] and 
Wallacher and Zimmerman [1991] have developed polynomial and 
strongly polynomial variants of this algorithm. Our first cycle- 
cancelling algorithm uses capacity scaling. Edmonds and Karp 
[1972] and Orlin [1988] have employed capacity scaling in their 
algorithm; their algorithms are not primal algorithms. Our 
algorithm selects an eligible arc with the maximum residual 
capacity. By solving a shortest path problem, either the selected 
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algorithm is pseudo -polynomial, our algorithm runs in 0(nm + n 

log n) time for the shortest path problem and the assignment 

problem; this complexity matches the complexity of best 

implementations of the network simplex algorithms for these 

problems developed by Glover and Klingman [1988] , and Akgul [1985, 

1994] . Our implementation and analysis is simpler. 

In Chapter 3, we develop two variants of the cycle-cancelling 
algorithm. The cycle-cancelling algorithm is credited to Klein 
[1967] . Goldberg and Tarjan [1988] , Barhona and Tardon [1989] and 
Wallacher and Zimmerman [1991] have developed polynomial and 
strongly polynomial variants of this algorithm. Our first cycle- 
cancelling algorithm uses capacity scaling. Edmonds and Karp 
[1972] and Orlin [1988] have employed capacity scaling in their 
algorithm; their algorithms are not primal algorithms. Our 
algorithm selects an eligible arc with the maximum residual 
capacity. By solving a shortest path problem, either the selected 
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arc is made noneligible, or its residual capacity is reduced at 
least by a factor of two by augmenting the flow along a negative 
cycle. VJhen arc capacities are integers, the algorithm runs in 
0(jn log U (m+n log n) time. 

Our second cycle- cancelling algorithm performs the following 
steps repeatedly on the residual network. The subgraph of the 
residual graph consisting of eligible arcs is made acyclic. This 
is done by using a cancel subroutine developed by Goldberg and 
Tar j an [1988] . Then a cut with noneligible forward arcs and at 
least one eligible backward arc is found; the maximum optimality 
violation over the arcs in this cut is reduced by a factor of at 
least two. When arc costs are integral, the algorithm runs in 
0(im log n log (nC) ) time. Incorporating a shortest path 
subroutine in the iterative procedure,' the algorithm becomes 
strongly polynomial and runs in O (nm^ (log n)^) . The complexity of 
our algorithm matches the complexity of the cancel -and- tighten 
^Isorithm developed by Goldberg and Tar j an [1988] 

In Chapter 4, we study arc tolerances for the separable 
convex cost flow problem which includes the minimum cost flow 
problem as its special case. Given an optimal flow, a convex cost 
function is a valid perturbation of the arc cost (convex) 
function if the replacement of the latter by the former 
preserves the optimality of the given flow. We show that there is 
an interval • which we call as the t-olBrance interval of 
arc (k, 1) , such that a convex function is a valid perturbation if 
and only if at least one of its marginal costs falls in the 
interval. Further, we characterize both and in terms of 
nonsingleton shortest distances between nodes k and t in the 



residual network. For the minimum cost flow problem, this is the 
interval in which the cost coefficient can vary while 
maintaining the optimality of the given flow. For the minimum 
cost flow problem, Shier and Witzgall [1980] have studied arc 
tolerances with respect to an optimal basis exploiting its 
spanning tree structure and have presented an O(n^) algorithm for 
computing arc tolerances for all arcs. Earlier, Srinivasan and 
Thompson [1972] have considered this issue for the transportation 
problem by so called basis preserving operators . The book by 
Ahuja et al. [1993] treats unit change in an arc cost 
combinatorially which can be extended for more general change . 
The book by Rockafellar [1984] contains a brief and general 
discussion on sensitivity analysis for the separable convex cost 
flow problem. Here our emphasis is on proper extension of arc 
tolerances to the convex cost flow problems and its 
characterization by nonsingleton shortest distances. We give an 
O (n^ ) algorithm for computing nonsingleton shortest distances 
between all pair of nodes. Our combinatorial approach enables us 
to study arc tolerances for any optimal solution to the minimum 
cost flow problem removing the effect of degeneracy as well as 
apply it to the more general convex cost flow problem. 

In Chapter 5, we study inverse network flow problems. Given 
a priori estimated cost c, the "nearness" of an arbitrary cost t 
to c is measured by a variance function k(t-c) , where Ji is a 
function having all properties of a norm except for symmetry; we 
call such a function as an xinorm. The inverse network flow 
problem is to perturb c to a cost t such that (i) a given observed 
flow is a minimum cost flow with respect to t, and (ii) h{t~c) is 
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minimum over all such t's. Burton and Toint [1992, 1994] have 
recently studied the inverse shortest path problem with Euclidean 
variance. Their motivation for studying this problem is its 
application in urban transit model and computerized tomography. 
Their emphasis is on developing a algorithm using a formulation of 
constraints in terms of paths. In this dissertation, we study the 
duals of inverse network flow problems which include inverse 
shortest path problem if the given paths originate from a single 
source . 

A natural generalization of the inverse network flow problem 
is the inverse linear programming problem where a given observed 
solution is a solution to a system of linear constraints. Using 
duality results in convex analysis, we first show that duals of 
inverse linear programming problems are certain feasible direction 
problems. Specializing this result, we show that duals of inverse 
network flow problems with Euclidean variance, the weighted 
rectilinear variance, and the weighted maximum variance are 
respectively equivalent to solving a separable strictly convex 
quadratic cost flow problem, a minimum cost flow problem and a 
minimum cost-to-weight ratio cycle problem. We also construct the 
required cost t after solving respective dual problems. We also 
show that minimum cost arc disjoint augmenting cycles with respect 
to the given flow represents an optimal solution to the 
rectilinear inverse network flow problem. 

We finally show that the dual of the rectilinear inverse 
spanning tree problem is equivalent to a transportation problem. 
This demonstrates that the inverse problem defined on a type of 
con*)inatorial problem need not be of the same type. 



Chapter 6 contains the concluding remarks. 

Since the problem dealt in various chapters are 
different, we survey the relevant literature chapterwise. 


quite 



Chapter 2 


NETWORK SIMPLEX ALGORITHMS FOR THE MINIMUM COST FLOW PROBLEM 


2.1 INTRODUCTION 

The simplex algorithm, due to Dantzig [ISBla], is one of the 
landmark contributions to computational mathematics of this 
century. The simplex algorithm plays a pivotal role in operations 
research and other related disciplines because of the 
pervasiveness of its applications throughout many problem domains, 
its extraordinary efficiency, and because it permits us to not 
only solve problems numerically, but also to gain considerable 
practical and theoretical insight through the use of sensitivity 
analysis and duality theory. 

Minimum cost flow problems define a special class of well- 
structured linear programs. The network simplex algorithm is a 
special implementation of the general (primal) simplex algorithm 
to the minimum cost flow problem, which exploits the underlying 
network structure . The attractiveness and empirical efficiency of 
the algorithm is due to the fact that the basic solutions of a 
minimum cost flow problem correspond to the spanning trees of the 
network G = (N, A) on which the problem is defined. Here W is the 
node set with n = INl nodes and A is the arc set with m = U1 
arcs. The essence of the algorithm is that it proceeds 
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successively from a spanning tree (solution) to another spanning 
tree (solution) , each obtained from the previous one by adding a 
new edge and deleting a tree edge, until an optimal spanning tree 
(solution) satisfying the optimality conditions is found. 

Dantzig [1951b] developed the network simplex algorithm for 
the uncapacitated transportation problem by specializing his 
linear programming simplex method. He proved the spanning tree 
property of the basis and the integrality property of the optimal 
solution. Later, his development of the upper bounding technique 
for linear programming led to an efficient specialization of the 
simplex method for the minimum cost flow problem. Dantzig' s 
[1962] book discusses these topics. 

The network simplex algorithm gained its current popularity 
in the early 1970s when the research community began to develop 
and test algorithms using efficient tree indices. Johnson [1966] 
suggested the first tree indices. Srinivasan and Thompson [1973] , 
and Glover, Karney, Klingman, and Napier [1974] implemented these 
ideas; these investigations found the network simplex algorithm to 
be substantially faster than the existing codes that implemented 
the primal -dual and out-of -kilter algorithms. 

Gassner [1964] has shown that the network simplex method can 
fail to terminate due to cycling, cycling occurs when the 
algorithm encounters repeatedly the same sequence of trees . This 
happens only when the algorithm performs degenerate pivots which 
change the spanning tree but not the solution. The strongly 
feasible spanning tree technique, proposed by Cunningham [1976] 
for the minimum cost flow problem, and independently by Barr, 
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Glover, and Klingman [1977] for the assignment probUem, helps to 
reduce the number of degenerate pivots in practice and ensures 
that the network simplex algorithm has a finite termination. 
Although the strongly feasible spanning tree technique prevents 
cycling during a sequence of consecutive degenerate pivots, the 
number of consecutive degenerate pivots can be exponential. This 
phenomenon is known as stalling. Cunningham [1979] and Goldfarb, 
Hao, and Kai [1990b] describe several antistalling pivot rules for 
the network simplex algorithm. The book by Ahuja et al. [1993, 
Chapter 11] develops the network simplex algorithm from first 
principles in a combinatorial way and deals with all the above 
concepts comprehensively. We adopt their approach for our 
algorithm. They also give a detailed literature survey on the 
network simplex algorithm. 

Edmonds and Karp [1972] were the first to devise a 
polynomial-time algorithm for the minimum cost flow problem. This 
development led the researchers to investigate the polynomial - 
time network simplex algorithm for the problem among other types 
of algorithms. 

Though many polynomial -time algorithms have been developed 
for the minimum cost flow problem (see, for example, Ahuja, 
Magnanti and Orlin [1993] ) , developing a polynomial -time network 
sxn^jlex algorithm for this problem has remained a challenging 
problem till very recently. Some previous partial success in this 
direction is a subexponential-time algorithm due to Tarjan [ 1991 ] , 
and polynomial -time network siii^lex algorithms due to Goldfarb and 
Hao [1988] and Tarjan [1991] where they occasionally allow pivots 
to increase the objective function value. 


Very recently, Orlin 



[1995] has succeeded in developing a genuinely polynomial -time 
network simplex algorithm for the minimum cost flow problem. 
However, many polynomial -time network simplex algorithms have been 
developed for the maximum flow problem, the assignment problem, 
and the shortest path problem. 

In this chapter, we present a new primal simplex pivot rule, 
which we call the minimum ratio pivot rule, and analyze the worst- 
case behavior of the resulting primal simplex algorithms for the 
minimum cost flow, assignment, and shortest path problems. We 
consider a directed network G = (N, .A) with node set N and arc set 
A. Let n = INI denote the number of nodes in the network, and m = 
|j|| denote the number of arcs in the network. Each arc (i, j) e A 
has a nonnegative integer arc capacity snd an arc cost 

We denote by A any upper bound on the sum of all arc flows, i.e., 

J] X. . A in every feasible flow x. 

{i,j)eA 

Our primal simplex algorithm first defines a penalty d^j for 
each arc (i, j) of the network, which is 0 or l. With respect to 
the arc penalties d^j's and the arc costs c^j's, the minimum ratio 
pivot rule is to select that eligible arc as the entering arc 
whose addition to the basis creates a cycle with the minimum 
cost-to-penalty ratio. We show that the primal simplex algorithm 
with the minimum ratio pivot rule solves the minimum cost flow 
problem in O(nA) pivots. Using simple data structures, this 
algorithm can be implemented in O(n^A) time, but using the 
Fibonacci heap data structure the running time can be improved to 
0(A(m + n log n) ) . For the assignment and shortest path problems, 
A = n; hence the primal simplex algorithm with the minimum ratio 
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pivot rule solves these problems in 0(n ) pivots and in 0{n{m + n 
log n) ) time. 

Srinivasan and Thompson [1977] used unit penalties in their 
area cost operator algorithm for the transportation problem. 
Since they perturb original cost, their algorithm is not genuinely 
primal simplex algorithm. Karp and Orlin [1981] , and Young, 
Tarjan, and Orlin [1991] used unit penalties in their algorithms 
for special parametric analysis for the shortest path problem. 

Table 2.1 presents a survey of the network simplex 
algorithms for the minimum cost flow problem and its special 
cases, and compares the worst- case complexity of the number of 
pivots and the time taken by these algorithms with the algorithms 
developed by us in this section. As is evident from Table 1, our 
network simplex algorithms for the minimum cost flow problem, the 
assignment problem, and the shortest path problem match the 
running times of the algorithms developed by Glover and Klingman 
[1988), and Akgul [1985, 1994]. Akgul's algorithms solve a 

sequence of problems on subgraphs = {N, A^) , = (N, A^) , ..., 

Gj, = (N, A^) , where A^ & A^ ^ ... £ = A. Given an optimal 

solution of the problem on G^, the graph obtained by 

adding all arcs incident to a specific node, and reoptimization is 
done using the network simplex algorithm with Dantzig's pivot 
• The reoptimization routine bears a close resemblance to an 
application of Dijkstra's algorithm. Glover and Klingman' s 
siso^ithm is also similar in spirit ; it also solves a sequence of 
problems on subgraphs G^ = (N, A^) , = {U, A^) , . . . , G^ = (N, 

, where is obtained from Gj^ by adding all arcs in {A - Ay^) 

that satisfy optimality conditions and exactly one eligible arc in 



Table 2.1 : Number of pivots and running times of various network 
simplex algorithms 


Optimization 

Problems 

Developers 

Number of pivots 

Running Time 


Orlin [1985] 
Glover and 

0 (nA log {mCU) ) 

OinmL log C) 


Klingman [1988] 

O(nA) 

0 (A (m+n log n) ) 

Minimum 

Tar j an [1991] 

O(n(log n /2 + 1 ) 

O(jj(log n /2 + 1 ) 

Cost 

Flow 

Problem 

Ahuja and 

Orlin [1992] 

m.min { log (nC), 
m log n}) 

9 

m min {log (nC) , 
m log n}) 



0 (nA log C) 

0 (mA log C) 


This chapter 

O(nA) 

0 (A (m+n log n) ) 


Orlin [1995] 

0(nm min { log (nC) , 

9 

0(n m min{log(nC) 



m log n}) 

m log n}) 


Goldfarb and 

Hao [1990] 

0 (ran) 

0 (n^m) 

Maximum 

Goldberg, 



Flow 

Grigoriadis & 



Problem 

Tar j an 

0(nm) 

0(im log n) 


Roohey - La 1 eh 

-3 



[1980] 

0{n^) 

0(n m) 


Hung [1983] 

0 (n^ log (nC) ) 

Oin^m log nC) 


Orlin [1985] 

0 (min{n log (nC) , 

0 (min {n m log 



n 

n m log n } ) 

inC) ,n^m^ logn}) 


Akgul [1985] 

O(n^) 

2 

0(nra+n log n) 

Assignment 

Glover and 


2 

Problem 

Klingman [1988] 

Oin^) 

0(nm+n log n) 


Ahuja and 




Orlin [1992] 

0(n log C) 

0(nm log C) 


This chapter 

O(n^) 

0{im+n log n) 


Akgul [1985] 

O(n^) 

2 

0(nm+n log n) 


Orlin [1985] 

9 

0(min{n log (nC) , 

9 

0(min{n m log 



n m log n}) 

(nC),nVlog n}) 

Shortest 

Goldfarb, Hao 

9 


Path 

and Kai [1990] 

0{n^} 

O(n^) 

Problem 

Glover and 

9 

2 


Klingman [1988] 

0(n"') 

0(nm+n log n) 


Ahuja and Orlin 

9 

0(nin log C) 


[1992] 

0(n log C) 


This chapter 

Oin^) 

0(im+n log n) 
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{A - Aj^) does not satisfy the optimality condition. Then, as in 
Akgul's algorithm, the network simplex algorithm with Dantzig's 
pivot rule is used for reoptimization. On the contrary, our 
algorithms consider all arcs in the network at the same time and 
use the eligible arc with the minimum cost-to-penalty ratio as the 
entering arc. We think that our pivot rule is quite natural, and 
its worst-case analysis is also considerably simpler. 

The organization of this chapter is as follows. 

In Section 2.2, we review the necessary background material 
for the minimum cost flow problem and present the network simplex 
algorithm in detail. In Section 2.3, we describe the 
minimum-ratio pivot rule in detail. In Section 2.4, we obtain a 
bound on the number of pivots performed by the resultant simplex 
algorithm. In Section 2.5, we obtain a worst-case time complexity 
of this simplex algorithm. In Section 2.6, we discuss the 
performance of the resultant algorithms for the special cases, the 
shortest path and assignment problems . 

2.2 THE NETWORK SIMPLEX ALGORITHM 


In this section, we present some background material for the 
minimum cost flow problem. The minimum cost flow problem has the 
following linear programming formulation: 


Minimize J c. . x. . 
Urj)eA 


subject to 


{J:U, J)^A} 


(2.1a) 


b(i) for all i e N, (2.1b) 


0 



s u. . 


ij 


for all (i, j) e A. 


(2.1c) 



In this formulation, if b(i) >0 then node i is called a 

supply node, and if 2>{i) < o then node i is called a demand node; 

if b(i) = 0, then node i is a transshipment node. We assume that 

all arc capacities u^j are integer, all supplies /demands Jb(i) are 

integer, and J] b(i) =0, We also assume that the minimum cost 
ieW 

flow problem has a feasible solution. The feasibility of the 
^ minimum cost flow problem can be ascertained by solving a maximum 

flow problem. We denote by A(i) the set of arcs incident to node 
i, i.e., .a{i) = { (fe, 1) e A', k = i ox 1 = i}. 

Basic Solutions and Optimality Conditions 

The network simplex algorithm maintains a basic feasible 
solution at each stage. A basic solution of the minimum cost flow 
problem is denoted by a triple (B, L, U) , where B, L and U 
partition the arc set A. The set B denotes the set of basic arcs, 
and L and U denote, respectively, the sets of nonbasic arcs at 
their lower and upper bounds. We refer to B as a basis and the 
triplet (B, L, U) as a basis structure of the minimum cost flow 
^ problem. It is well-known that each basis B of the minimum cost 

flow problem is a spanning tree of G. A basis structure (B, L, U) 
is called feasible if by setting x^j = 0 for each (i, j) € L and 
by setting x^j = for each (i, J) e U, the problem has a 

solution satisfying {2.1b) and (2.1c). 

A dual solution to the minimum cost flow problem is a vector 
IT of node potentials , and a vector c of reduced costs defined as 
c^j = c^j - n(i) + n{j) for each- (i, j) e A. A feasible basis 
structure (B, L, U) is called an optimal basis structure if it is 
possible to obtain a set of node potentials tt so that the reduced 
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costs satisfy the following optimality conditions : 


c^j = 0 for each (i, j) e B. 
Cjj a 0 for each (i, j) e L, 
c^j s 0 for each (i, J) e U. 


(2.2a) 

(2.2b) 

(2.2c) 


Given a basis structure, the node potentials can be 
determined uniquely by setting 7 t( 1) = 0 and then using (n-1) 
equations of (2.2a). A nonbasic arc (i, J) not satisfying (2.2b) 
or (2.2c), whichever is applicable, violates its optimality 
condition. We refer to an arc violating its optimality condition 
as an eligible arc. We refer to the vector n as cost-potentials . 


Computing a basic solution involves only addition and 
subtraction of the quantities u^j' s and b(i)'s; similarly 
computing the node potentials corresponding to a basis involves 
only addition and subtraction of costs c^j's. This is due to the 
fact that the underlying matrix in equations (2.1b), called the 
node-arc incidence matrix, is totally unimodular (i.e., each 
square submatrix of the matrix has determinant 0 or ±1) . A 
detailed essposition of the property can be found, for example, in 
Ahuja et al. [1993] and Schrijver [1986] . As a consequence, we 
have the following properties . 


Property 2.1 (Primal Integrality Property). If capacities of all 
the arcs and supplies/demands of all the nodes are integer, the 
minimum cost flow problem always has integral basic solution. 

Property 2. 2 (Dual Integrality Property ) . If all arc costs are 
integers, the node potentials corresponding to any basis of the 



minimum cost flow problem are integers, and hence the reduced 
cost of each arc is also integer. 

Example 2.1 Consider the network shown in Figure 2.1. The flow 
given is a basic solution. 

B = {(1, 2), (3, 2), (4, 3), (5, 2), (5, 6), (7, 5)}; 

L = {(3, 1). (4, 5), (7, 4)}; 

U = { (6, 3) , (1, 5) } . 

Figure 2.2 gives the costs and node potentials. The reduced 
cost of nonbasic arcs are shown within the brackets; For basic 
arcs, the reduced costs are zero. Both arcs (6, 3) and (1, 5) in 
U are eligible arcs. In L, arc (4, 5) is eligible. 

We consider the spanning tree corresponding to a basis as 
"hanging" from node 1. The tree arcs either are upward pointing 
(toward node 1) or are downward pointing (away from node 1) . We 
associate three indices with each node i in the tree: a 

predecessor index, pred(i), a depth index, depth(i), and a thread 
index, thread(i). Each node i, other than node 1, has a unique 
path connecting it to node 1. The predecessor index pred(i) 

stores the first node in that path (other than node 1) , and the 
depth index stores the number of arcs in the path. For node 1, 
these indices are zero. We say that pred(i) is the predecessor of 
node i, and i is the successor of node pred(i) . The descendants 
of node i consist of node i itself, its successors, the successors 
of its successors, and so on. The set of descendants of any node 
i induces a subtree rooted at node i. We denote the nodes of the 
subtree by the set D(i) . Node i is called an ancestor of the 
nodes in D(i) . The thread indices provide a means for visiting 
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(or finding) all descendants of a node i in 0(|D{i)|) time. For a 
detailed description of the tree indices, see Kennington and 
Helgason [1980] . In the basis, there is a unique path connecting 
any two nodes. We refer to this path as the basis path. The tree 
indices for the basis given in Figure 2.1 are given in Figure 2.3. 


The network simplex algorithm works as follows. It starts 
with an initial basic feasible flow x and the corresponding basis 
structure (B, L, U) . It selects an eligible arc [h, 1) to enter 
the basis. Adding arc (k, 1) to the basis forms a unique cycle W, 
we refer to this cycle as the pivot cycle. If the eligible arc 
(k, 1) is at its lower bound, then we define the orientation of 
the basis cycle along arc (k, 1) , and send maximum possible flow 
in the basis cycle without violating any of the lower and upper 
bound constraints on arcs. However, if the eligible arc (k, 1) is 
at its upper bound, then we define the orientation of the basis 
cycle opposite to the direction of arc (k, 1) and send maximum 
possible flow. To avoid this case analysis (whether the eligible 
arc is at its lower bound or at its upper bound) and to simplify 
the subsequent proofs, we shall henceforth assume that whenever 
Xj^j^ at its upper bound enters the basis, we replace it by the 


variable Xj^j^ = 


^kl ^Ik basis at its lower 


bound. Notice that for an eligible arc (k, 1) at its upper bound, 
^kl ^ when we replace it by its reversal, (1, k) , its 

As a result, in our svibsequent 


TT TT 

reduced cost . 

discussion we shall assume that the entering arc (k, 1) is always 
at its lower bound and < 0. For example, consider the arc 

(6, 3) in Example 2.1, which is at its upper bound. Making the 
substitution xi,^, = = 6 - amoxmts to replacing the 
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Fi^ire 2.3 Example of a tree indices: 

<a) a rooted tree 

(b) corresponding tree indices. 














arc (6, 3) by its reversal (3, 6) with flow 0 and capacity 6. 

Since = 8, c^g = -8. 

Once the orientation of the pivot cycle V has been defined, 
we augment maximum possible flow, say S, along it, given by 

8 = min{5^^. : (i, j) e Iff}, where (2.3) 

“ij “ ^ ^ 

if (i, j) e V , 

and Iff and V respectively denote the sets of forward arcs (i.e., 
those along the orientation of Iff) and backward arcs (those 
opposite to the orientation of Iff) in the pivot cycle. At this 
point some arc, on which the minimum in (2.3) is attained, in the 
cycle blocks further increase in the flow. The algorithm drops 
such a blocking arc (p, q) , and obtains a new basis structure. 
The sequence of steps involved in moving from one basis structure 
to another is called a pivot iteration. A pivot iteration is 
degenerate if 8 = 0, and nondegenerate if 8 > 0. In Example 2.1, 
pivot iteration on arc (1, 5) is degenerate, i.e., 8 = 0, and the 
pivot iteration on arc (6, 3) is non- degenerate and augments 8=2 
units of flow. The pivot operation might change some node 
potentials too. If (k, 1) * (p, g) , the node potentials change. 
Let S and S be the subsets of nodes formed by deleting arc (p, g) 
from the previous basis B, where S contains node 1. In the new 
basis, potentials of all nodes in S remain unchanged and 
potentials of all nodes in S change by a constant amount. If k € 
S, then the potential of each node i e S changes to Tr(i) - cj,; 
and if k € S, then the potential of each node i eS changes to iT(i) 
+ In Example 2.1, the arc (5, 2) is the leaving arc in the 
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since the arc (l, 5) is at its 


pivot iteration on arc {1, 5) • 
upper bound, the arc (1, 5) is reversed; the pivot iteration is 

considered to be the arc (5, 1). Here S = {5, 6, 7} and 5 e S. 
The potentials of each node i in S change to u{i) + ~ 

Our network simplex algorithm maintains a strongly feasible 
basis at every iteration. We say that a basis structure (B, L, U) 
is strongly feasible if one can send a positive amount of flow 
from any node in the spanning tree to node 1 along arcs in the 
tree without violating any of the flow bounds . An equivalent way 
of stating this property is that no upward pointing arc of the 
spanning tree can be at its upper bound and no downward pointing 
arc can be at its lower bound. The basis structure given in 
Example 2.1 is strongly feasible. 

The network simplex algorithm selects the leaving arc 
appropriately so that the next basis is also strongly feasible. 
Let W be the pivot cycle formed by adding arc (k, 1) to the basis 
tree. We call the first common ancestor of nodes k and 1 as the 
apex node of cycle W. The pivot cycle consists of the basis path 
from the apex node v to node k, the arc (k, 1) , and the basis path 
from node 1 to node v. After updating the flow, the algorithm 
identifies blocking arcs. If the blocking arc is unique, then it 
leaves the basis . If there are more than one blocking arcs , then 
the algorithm selects the leaving arc to be the last blocking arc 
encountered in traversing W along its orientation starting at node 
V. It can be shown (see, for example, Cunningham [1976] and 
Ahuja, Magnanti and Orlin [1993] ) that the above rule guarantees 
that the next basis is strongly feasible. 



We shall now observe a few facts about the degenerate pivots 
that will be used later. Notice that in a strongly feasible 
basis, we can send a positive amount of flow from any node to node 
1 using the tree arcs. This implies that in a degenerate pivot, 
all blocking arcs will lie in the basis path from node v to node 
k. (Recall that we make the assumption that the entering arc (k, 
I) is at its lower bound) . Consequently, the leaving arc will 
also lie in the basis path from node v to node h. As a result, 
the set S (as defined previously) will always contain node k and 
the potentials of each node i e S will change to 7T(i) + 

We also need to perform the degenerate pivot cleverly, else 
they will take too much time. We incorporate an additional test 
in the method described by Mulvey [1978] , to identify the basis 
cycle for an entering arc (k, 1) . We trace the predecessor 
indices of nodes k and 1 backward to the root node until (i) 
either we locate the first common ancestor node, (ii) or we 
identify a blocked arc (this is the additional test) . In the 
fomer case, the pivot will be nondegenerate; and in the latter 
case, the pivot will be degenerate. In the latter case, the time 
spent in the method can be charged to updating the potentials of 
nodes in S. In a degenerate pivot, no flow is augmented so we 
ignore the augmentation time. The point we wish to make is that 
during degenerate pivots, time to update the node potentials is 
the bottleneck step. 

We summarize our discussion on degenerate pivots in the 
following properties for future reference. 


\ 
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Property 2.3 : In a degenerate pivot, potential Ti(i) of each node 
i € S changes to 7 r(l) + where {k, 1) is the entering arc and 

S is the subset formed by deleting the leaving arc from the 
previous basis tree and not containing the root node 1 . 

Property 2.4 : A degenerate pivot can be performed in 0(1S|) 

time. 

The following property is useful in our analysis. 

Property 2.5 : Let g ^ > 0 and d > 0. Then s g . 

Proof. The condition 5 ^ g implies ad a be. Adding ab to both 
the sides yields a (b+d) £ b(a+c), which immediately implies the 
property. 

2.3 THE MINIMUM RATIO PIVOT ROLE 

The network simplex algorithm can select any eligible arc as 
the entering arc. Different rules for selecting the entering arc, 
rules, produce algorithms with different empirical 
and theoretical behaviors. In this chapter, we study the behavior 
of the network simplex algorithm with the minimum ratio pivot 
rule, which we describe next. 

Let {B°, L°, u°) be the initial (strongly feasible) basis 

structure used in the network simplex algorithm. Let Q be the set 

of eligible arcs with respect to the spanning tree structure (B°, 
o o 

L . O ) . Recall that we have made the assumptions that all 
eligible arcs are at their lower bounds . Define a penalty d^ . for 
each arc ( 1 , j) e A in the following manner : 



' 1, if (i, j) is eligible. 

^ 0, if (i, j) is not eligible. 


(2.4) 


d. . = 
ij 


We point out that we use the initial spanning tree structure 
to define the arc penalties, which remain unchanged throughout the 
algorithm (similar to the arc costs) . 


The assumption that all eligible arcs in the initial spanning 
tree are at their lower bound is not restrictive. This can be 
overcome by defining the penalty of an eligible arc (i, j) at 
its upper bound as -1; the penalty for other arcs are defined in 
the same manner as in (2.4). For example, in Example 2.1, the 
(4, 5) is at its lower bound and its penalty is 1. 

All other eligible arcs (1, 5) and (6, 3) are at their upper bound 
and their penalties are -1. The rest of the arcs are non-eligible 
and their penalties are zero. However, by replacing the arcs (1, 
5) and (6, 3) by their reversals (5, 1) and (3, 6), the arcs (4, 
5) , (5, 1) and (3, 6) in the transformed network are eligible and 
at their lower bound; their penalties are 1. 


Let (B, L, U) be an arbitrary feasible basis structure and 
{k, 1) be an eligible arc. Adding the arc (Jc, 1) to the basis 
creates a pivot cycle, which we denote by Define the 
orientation of the cycle along the arc (k, 1) . Let Cj^j, denote 
the cost of the fundamental cycle defined as the sum of the 
costs of the arcs in along its orientation minus the sum of 
the costs of the arcs in opposite to its orientation. Recall 
from Section 2 . 2 that the orientation of the cycle is same as that 
of the arc (k, 1) , since by our assumption eligible arc (k, 1) is 
at its lower bound. In a similar fashion, we define the penalty 
of the cycle denoted by Then, the cost-to-penalty ratio 
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is denoted by noneligible arcs, it is zero. 
The minimum ratio pivot rule always selects an eligible arc with 
the minimum cost-to-penalty ratio. 


Let W.j denote the set of arcs in Wj^j^ along its orientation 
riJL 

and W., denote the set of arcs in W., opposite to its orientation. 
Then , we have 


'kl 


I _ 

(i, 


^ij 


(i,j)6V^2 


ij 


(2.5) 


and 


'kl 


(i,J) 


- 






( 2 . 6 ) 


Recall our discussion in Section 2.2, where we define the cost- 
potentials n as satisfying 

n(l) = 0 , 

and (2.7) 

c^! . = c. . - TT(i) + n(j) = 0 for each arc (i, j) e B. 


If we replace each by c^j in expression (2.5), then the 

expression remains intact (because n(i)'s cancel out). Next 
observe that each arc (i, j) e V is in B, except the arc {k, 1), 


and each arc (i, j) e B has = 0. Consequently, 

C - c" 

'^kl ~ ^kl 


( 2 . 8 ) 


We also maintain a penalty-potential ju to simplify the 
e3q)ression In a similar way as the cost -potentials n is 

defined, we define the penalty-potentials ijl as satisfying 
U(2} =0 

and (2.9) 

~ ^ii ~ M(j) = 0 for each (i, j) e B. 



By similar reasoning as applied to the expression for we have 

^ ^ 1 * ( 2 . 10 ) 

From equations (2.8) and (2.10), we have the following property. 


Property 2.6 ; ' 


We refer to as the reduced cost of arc (k, 1) and as 
the reduced penalty of arc {k, 1) . We also point out that 4=0 
at the initial iteration since d^. = 0 for each arc in B. The 
following property is useful in our analysis. 


Property 2.7 : The penalty-potentials 4 (and the reduced-penalty 
d^) are integral. Further, 


-(n- 1 ) s 4 {i) < n -1 ( 2 . 11 ) 

Proof. The integrality of 4 (and d*^) follows from the dual 
integrality property, since integer. The inequality 

( 2 . 11 ) follows from the fact d. . = 0 or 1 , and 4 (i)'s satisfy the 

IJ 

equations ( 2 . 9 ). 


Our network simplex algorithm maintains both the 
cost-potentials and penalty-potentials, using which the cost-to- 
penalty ratio of any eligible arc {k, 1) can be computed in 0(1) 
time . 

2.4 BOUNDING THE NUMBER OF PIVOTS 

We now analyze the worst -case complexity of the network 
simplex algorithm with the minimum ratio pivot rule. In this 
section, we first count the number of nondegenerate pivots and 
then count the number of degenerate pivots. In the subsequent 
section, we obtain the running time of the algorithm using two 
different data structures? array and Fibonacci heaps. 



We analyze the worst-case complexity of the algorithm in 
terms of the parameter A, which is an upper bound on the sum of 
the arc flows in any feasible flow, i.e., A £ for 

every feasible flow x satisfying (2.1b) and (2.1c). Our 
assumption that all eligible arcs are at their lower bound 
simplifies much of our presentation. Without loss of generality, 
we extend this assumption to all nonbasic arcs, i.e., all nonbasic 
arcs in a basic structure are at their lower bound; if necessary, 
we replace the arcs at their upper bound by their reversals as 
described in Section 2.2. Our analysis uses the following 
results, which we state and prove with assumption that all 
nonbasic arcs are at their lower bound. 


Lemma 2.1 : For the netvork simplex algorithm using 
ratio pivot rule at each iteration, each arc satisfies 
cj. - . 0, 

for some X < o. 




( 2 . 12 ) 


Proof : Each basic arc (i, j) satisfies c^j = d^j = 0; hence the 
condition stated in the lemma holds. For nonbasic arcs, we prove 
this result by performing induction on the number of iterations. 
Consider the first iteration. Each nonbasic eligible arc (i, j) 
satisfies = d_.^. = i (because m = 0) . Hence (2.12) reduces to 
^ " ^ij^^ij eligible arcs. We can set X equal to the 
minimum cost-to-penalty ratio among all eligible arcs in order to 
satisfy (2.12). We now consider any arbitrary iteration and show 
that If (2.12) holds before a pivot iteration, then it will hold 
after the pivot iteration too. In the pivot iteration, let arc 
(k. 1) he the entering arc. Let « = /S = d^^, and = «/p. 
Since arc (/c, i) satisfies (2.12), and cj, < 0, (2.12) could be 
true only if > 0 , Therefore, = a/|3 < o. 



We first note that (2.12) holds for A = before the pivot 
iteration. To see this, we use a result from parametric linear 
programming (see, for example, Murty [1976]) which says that if 
(2.12) holds for some X for some basis, then it must hold for all 
X e [X^, X 2 ] , X^ s X s X 2 , for the same basis, where 

X^ = max : d^j < 0 and (i, j) € .A j-, (2.13) 

and 

X 2 = min I > 0 and (i, j) e Jl 1, (2.14) 


Now consider the expression (2.14). Since the current basis is 
not optimal, there must be an eligible arc (i, j) € A. For this 


arc (i, j) , c^j < 0, and since it satisfies (2.12) for some X < 0, 
d^j > 0. This is true for every arc currently eligible. Since 
c^j/d^j < 0 for this arc, we can ignore the terms corresponding to 
non-eligible arcs (i.e., the arcs with . fe 0 and d(f . > 0) in the 

ij ij 

expression (2.14). Consequently, 

X2 = min eligible arc j-. 


That is, X 2 is the minimum cost -to -penalty ratio, which is same as 
X^ by the choice of arc (k, 1) . Hence (2.12) holds for ^ 
before the pivot iteration. 


Now, we prove that (2.12) holds for ^ after the pivot 

iteration, which proves the lemma. Suppose that the pivot 
operation changes the potentials of the set S of nodes. It 
follows from our discussion in Section 2 . 2 that for each node i e 
S, (i) either n(i) and iii(i) become 7r(i) + a and |i{i) + P 
respectively; (ii) or ir{i) and M(i) become 71 (i) - a and iiii) - 0 
respectively. We consider case (i) only; the treatment for case 



(ii) is similar. Clearly, the reduced costs and reduced penalties 
of arcs in the cut [S, S] change, and for other arcs they remain 
unchanged. We consider only the forward arcs in the cut [S, S] ; 
the treatment for the backward arcs is similar. For a forward arc 
{i, j) in the cut, i e S and j e S, and by definition, = a/p, 
or a - X p = 0, and Xq satisfies (2.12) before the iteration. 
Subtracting a - X^p = 0 from (2.12) yields (c^ ^ - a) - - p) 
a 0, which can be rearranged as c^j - where n' and u' 
are the modified potentials after the iteration. ■ 

T.**mwia 2.2 : For the network simplex algorithm using the minimum 
ratio pivot rule, each eligible arc (i, j) satisfies c^j < 0 and 

d^j > 0. 

Proof : From Lemma 2.1, each arc (i, j) satisfies c^j - kd^j fc 0 
for some X < 0. An eligible arc (i, j) has Cj.j < 0. Hence, if 
this arc has d^j s 0, then it will violate (2.12). Consequently,, 
d'f. > 0. ■ 

Our subsequent analysis uses counting of increases and 
decreases in the penalty-potentials, hence we will state a 
property useful in this respect. Recall Property 2.3 which states 
that during a degenerate pivot the cost -potential of each node i e 
S changes to Tr(i) + Applying the same property to 
penalty-potential implies that during a ‘ degenerate pivot the 
penalty-potential of each node i e S changes to 4(i) + di!, . Since 
for each eligible arc {k, 1), < 0 and d}J_j > 0, we get the 
following result. 

Property 2.8 : During a degenerate pivot operation, if a penalty- 
potential (or, cost -potential) changes, then it increases by djj^^ 
units (or decreases by tinits) . 



An easy consequence of Property 2.8 is that the network 
simplex algorithm with the minimum ratio pivot rule prevents 
stalling ; an exponentially long sequence of consecutive degenerate 
pivots (see Cunningham (1979) and Hao and Kai [1990b] ) . Each 
degenerate pivot increases some penalty -potential ixii) by at least 
one unit (because is an integer by Property 2.7) . Since each 

penalty-potential satisfies -n s u(i) s n (by Property 2.7), there 
can never be more than 2n consecutive degenerate pivots. Thus we 
have proved the following result. 

Theorem 2.1 : The netvork simplex algorithm with the minimum 

2 

ratio pivot rule performs at most 2n consecutive degenerate 
pivots. 

We now obtain a bound on the number of nondegenerate pivots . 

Let us define the penalty of the flow as d{x) = 1 )/ - , d. . x. . 

\X , j ) eA ij xj 

(similar to the cost of the flow, c{x) = I/.- , c. .x. .) . Since 

r J ) € A JL Jf 1 J 

d. . = 0 or 1 and x.. fe 0, we have 0 £ d(x) ^ Z/- m x. . ^ A. Due 

•IJ -IJ \1 f J ) 1 J 

to the primal integrality property (Property 2.1), during a 
nondegenerate iteration, 5 & 1 units of flow is augmented along 
the pivot cycle introduced by the entering arc (Jc, 2) . By Lemma 
2.2. > 0; since d^^ are integers (Property 2.7), d^^ a 1. 

Therefore the penalty of the flow, d (x) , increases by 5 dj^^ ^ ^ 
units in a nondegenerate pivot. The maximum possible increase in 
d(x) is at most A and, consequently, the algorithm will perform at 
most A non -degenerate pivots. 

To obtain a bovind on the number of degenerate pivots 
performed by the algorithm, we need to establish the following 
result . 
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Lemma 2.3 ; Any penalty potential n(i ) increases at most 2n+L 
times. 


Proof : It follows from Property 2.8 that a penalty-potential u(i) 
can decrease only during a nondegenerate iteration, and if arc (k, 
1) is the entering arc, then it can decrease by at most d^j units. 
But also notice that in this iteration d (x) also increases by at 
least djl^j units. As d(x) can increase by no more than A units, 
any penalty-potential /i(i) can not decrease by more than A units. 
This observation together with Property 2.7 ’implies that in the 
course of the entire algorithm, n{i) can increase by at most 2n+A 
units, thereby establishing the lemma. ■ 

This lemma immediately implies that the number of degenerate 
pivots is at most n(2n+A) because the network contains n nodes and 
each degenerate pivot increases at least one uii) . We summarize 
the preceding discussion as the following theorem. 

Theorem 2.2 ; The network simplex algorithm with the minimum 
ratio pivot rule performs at most 2A nondegenerate pivots and at 
most n(2n+L) degenerate pivots. 

2.5 BOUNDING THE RUNNING TIME 

In this section, we obtain a bound on the worst-case running 
time of the algorithm. Needless to say, the running time of the 
algorithm depends upon the data structure used to implement the 
algorithm. We describe in detail the implementation of the 
algorithm using Fibonacci heap data structure developed by Fredman 
and Tar j an [1984] . Later we point out the running time of the 
algorithm using arrays and binary heaps . 



A heap is a data structure that stores a collection of 
objects (which in our case are nodes ) , where each object has an 
associated index, called its key. A heap is capable of performing 
the following operations : 

find-min(i) : Find an element i with the minimum key in the heap. 
delete-min(i) : Delete the element i with the minimum key in the 

heap. 

decrease-keyCi, value) : Decrease the key of element i to a 

smaller value, denoted by value. 

increase-key (if value) : Increase the key of element i to a larger 

value, denoted by value. 

A binary heap data structure performs each of the above heap 
except find-min (which takes 0(1) time), 
operation^ ^in O(log n) time, where n is the maximum number of 

elements present in the heap (see, for example, Cormen et al. 

[1990] ) . A Fibonacci heap data structure performs each of the 

find-min and decrease-key operations in 0(1) time, and each of the 

delete-min and increase-key operations in 0(log n) time (see 

Fredman and Tarjan [1984]). 

To implement our network simplex algorithm using heaps, we 
define the following key for each node i e N •. 

key(i) = min{y^j : (i, j) e Q) (2.15) 

where y . . = c” ./d^ . and Q is the set of outgoing eligible arcs at 
node i. In other words, the key of node i is the minimum ratio 
among outgoing eligible arcs at node i. If node i has no eligible 
arc emanating from it, then we set key(i) =0. We also maintain 
another index, arc(i), for each node i e W; arc(i) stores the arc 
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emanating from node i whose cost-to-penalty ratio equals key(i). 
If key(i) = 0, then arc(i) is undefined. In this implementation, 
the algorithm will work in the following manner. We perform a 
find-min operation to identify a. node, say node K, with the 
minimum key; the arc(k) gives the arc having the minimum key. If 
the minimum key is zero, then there is no eligible arc and we 
terminate the algorithm. Suppose that the minimum key is nonzero. 
Let (Jc, 1) = arc(k). Next we perform a pivot operation with arc 
(k, I) as the entering arc. Suppose that the pivot operation 
changes the potential of a subset S of nodes. This changes the 
cost-to-penalty ratios of arcs in the cut [S, S] . As a result, 
keys of several nodes need to be updated. We will study the 
effort needed to make these changes separately for degenerate and 
nondegenerate pivots. 

For a nondegenerate pivot, find-min operation requires 0(1) 
time. But augmenting the flow along the basis cycle and updating 
the node potentials and tree indices takes 0(n) time. We also 
compute the key of each node afresh, which requires a total of 
0(jn) time. The modified key of a node i may be lower than (case 
1) , or higher than (case 2), or equal to (case 3) its previous 
key. To update the Fibonacci heap, in case 1 we perform a 
decrease-key operation, in case 2 we perform an increase-key 
operation and in case 3 we do nothing. In the worst -case, we 
perform n increase-key operations requiring a total of 0(n log n) 
time. Considering the times of all the operations, we can 
conclude that we can execute a nondegenerate pivot iteration in 
0{m + n log n) time. As the algorithm performs at most A 
nondegenerate pivot iterations, the total time spent on 



■nondegenerate pivots is O (A (m + n log n) ) . 


We next consider the time spent on degenerate pivots . As 
earlier, find-min operation takes 0(1) times. We now use Property 
2.4 which states that the time to perform a degenerate pivot can 
be charged to updating the potentials of nodes in S. In 
degenerate pivots, we do not recompute the key of every node in N 
(because it will take too much time) , but recompute the keys of 
only those nodes whose potentials change during the pivot, namely, 
the nodes in S. Recomputing the keys of nodes in S takes 
O (1) I ) time, and updating the Fibonacci heap takes 0(|S1 
log n) time. Updating the potentials of nodes in S modifies the 
cost-to-penalty ratios of arcs in [S, S] due to which the keys of 
some nodes in S will also change. We shall now prove a crucial 
observation that the keys of nodes in S either stay the same or 
they decrease. This observation will allow us to update the keys 
of nodes in S by perfoorming decrease-key operations which are much 
more efficient than increase-key operations. 


Consider any node i € S. As earlier, let Q be the set of 
eligible arcs. If for each arc (i, j) emanating from node i, J e 
S, then key(i) remains unchanged; otherwise it might change. Arc 
(i, j) will satisfy one of the three following conditions : (i) it 
is ineligible before the pivot and it remains ineligible; (ii) it 
is ineligible before the pivot but it becomes eligible after the 
pivot; and (iii) it is eligible before and also after the pivot. 
In the first case, the cost-to-penalty ratio of arc (i, j) remains 
zero and in the second case it strictly decreases. We now 
consider the third case. Suppose that there is an arc (i, j) 
emanating from node i for which j e S. It follows from Property 



2.8 that the potentials n{j) and n(j) become n(j) + and uij) + 

after the pivot operation. These changes will modify the 

ajL 

reduced cost of arc (i, J) to c^j + and the reduced penalty of 

arc (i, j) to . dj;,. Hence the modified cost-to-penalty ratio 
of arc (i, j) will be {c^j + + cr}J_j) • Using the facts (i) 

/d^j a (ii) d^j > 0, and (iii) dj^j > 0, we obtain 

(c^. + cj,)/(d^. + diJ,) s Jd^.. [Here we make use of the 
Property 2.5 that if|s|,i>0, d>0, then ^ f ^ 

preceding discussion establishes that in a degenerate pivot, keys 
of nodes in S either stay the same or decrease. We can update the 
keys for node in S in the following manner. We consider each node 
j € S one by one, and for each such node under consideration we 
examine incoming arcs at node j one by one. If for any arc (i, 
j) , i e S, we recompute the cost-to-penalty ratio of the arc. If 
this ratio is less than key(i) , we perform a decrease-key 
operation requiring 0(1) time. We also update arc(i). Clearly, 
using this method, we can update the keys of nodes in S in a total 
of 0{j;^ggU{i) I) time. 

We are now in a position to bound the time taken by the 
algorithm during the degenerate iterations . We have shown thus 
far that if during a degenerate iteration, potentials of a subset 
S of nodes change, then updating the keys and the Fibonacci heap 
requires 0(|S|log n + time. Now observe that in all 

the degenerate iterations, any node can belong to S at most 0{n+A) 
times because each time a node belongs to S its potential changes 
and, by Lemma 2.3, the potential of any node can change at most 
2n+A times. This implies that (i) if we sum |S| over all the 
iterations, then it would be no more than n(2n+L) and (ii) if we 



sum over all the iterations then it would be no more 
than m{2n+L) . Under the reasonable assumption that A a n, these 
observations give a bound of 0(A(jn+n log n) ) on the time taken by 
degenerate iterations, which is the same as the time taken by the 
nondegenerate iterations. We can summarize our discussion thus 
far in the form of the following theorem. 

Theorem 2.3 : The netvork simplex algorithm using the minimum 
ratio pivot rule performs O(nL) pivots and can be implemented in 
0(A(m+n log n)) time. 

Binary heap implementation 

To implement the algorithm in a binary heap data structure, 
we can create a binary heap with arcs in A as data item; each arc 
(i, j) in the heap has its cost-to-penalty ratio as its key. 
In each iteration, we select an arc with the minimum 
cost-to-penalty ratio by selecting the arc with min-key in the 
binary heap. As we pointed out at the beginning of this section, 
all heap operations find-min, delete-min, increase-key, and 
decrease-key, take O(log m) = O(log n) time in a binary heap. 

In each non-degenerate iteration, we compute the key of all 
arcs afresh, which takes 0(m log n) time; the time required for 
all other operations updating node potentials and augmenting the 
flow, is dominated by this time. Since the algorithm performs at 
most A nondegenerate pivots {Theorem 2.2), the time required for 
nondegenerate iterations is 0(A m log n) . 

We update the keys of the arcs in degenerate iterations by 
scanning the adjacency list A{i) of each node i in the set S {the 
set of nodes for which node potential changes) . Note that the key 
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of only arcs in the cut [S, S] change. Whe.n a node i is in S, its 

jLi(i) increases, which happens at most {2n+A) time by Lemma 2.3. 

Thus the number of times all arcs in A are scanned in degenerate 
pivots is the sum of the ejtpression I over all degenerate 

iterations, which is O(inA). All operations in a degenerate 
iteration, except updating keys, takes 0(|S| time, hence this time 
can be charged to arc scanning time, which is 0(A m) . Since 

updating a key of an arc once takes O(log n) time and all arc 
change their keys at most 0(A m) times, the time for updating keys 
is 0(A m log n) . Consequently, the time taken for degenerate 
pivots is 0(A m log n) , which is the same as that for 
nondegenerate pivots. Therefore, the algorithm runs in 0(A m log 
n) time, when implemented using binary heaps. 

Array implementation 

The array implementation of the algorithm is same as the 

Fibonacci heap implementation, except that the key for each node 
in N is stored in an array of n elements. In the array data 
structure, finding the minimum key takes 0(n) time; the operations 
decrease-key and increase-key operations take 0(1) time. Except 
for the time taken for the min-key operations in degenerate 
pivots, the time bound for other operations remains intact. Since 
the number of degenerate pivots is 0(n A) (Theorem 2.2), the time 

taken for min-key operations in degenerate pivots is 0(n A) . 

2 

Consequently, the algorithm runs in 0(n A) time. 

The time bound we obtain for the network simplex algorithm 
with the minimum ratio pivot rule is pseudopolynomial . The 
algorithm, however, would run in polynomial time if A is 



polynomial in terms of the input size parameters. As discussed in 
the next section, the assignment and shortest path problems have A 
= n, and the algorithm solves those problems in polynomial time. 

2.6 SPECIFIC IMPLEMENTATION 

In this section, we specialize the network simplex algorithm 
and its complexity results to the assignment and shortest path 
problems . 

Assignment Problem 

The assignment problem is a minimum cost flow problem (2.1) 
on a bipartite network G = (N^vN^i A) such that |W^| = 1 ^ 2 ! = n/2, 

A Z X N^, b{i) =1 for all i e and b{i) = -1 for all i e N^- 
The special structure of the assignment problem implies that in 
any basic feasible solution, n/2 arcs carry unit flow and the 
remaining arcs have zero flow (see, for example, Barr, Glover and 
Klingman [1977]). Therefore, for the assignment problem, A = n/2. 
Specializing the results of the preceding sections yields that 
when applied to the assignment problem, the network simplex 
algorithm with the minimum ratio pivot rule will perform 0(n) 

nondegenerate pivots, 0(n ) degenerate pivots and would irun in 
2 

Oinm + n log n) time. 

Shortest Path Problem 

We next study the performance of our network simplex 
algorithm on the shortest path problem. The shortest path problem 
is to identify a path of minimum cost from a specified source node 
s to another specified sink node t . The shortest path problem can 

central library 
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be formulated as a minimum cost flow problem (2.1) by setting b(s) 
= 1, bit) = -1, and b[i) = 0 for the remaining nodes. A feasible 
solution of the shortest path problem consists of unit flow along 
a directed path from node s to node t and zero flow on rest of the 
arcs. Therefore, similar to the assignment problem, the shortest 
path problem satisfies the property that O in) arcs carry unit flow 
and the remaining arcs have zero flow. Consequently, our network 
simplex algorithm will solve the shortest path problem within 
O(n^) pivots and in 0(nin + log n) time. We summarize our 
discussion with the following result : 

Theorem 2.4 : The netvork simplex algorithm using the minimum 

ratio pivot rule solves the assignment problem as veil as the 

2 2 

shortest path problem vithin 0(n ) pivots and in 0(nm + n log n) 
time. 

We point out that in the network simplex algorithm for the 
shortest path problem every basis is a directed out -tree rooted at 
the source and the optimal basis is a shortest path tree (see, for 
example, Ahuja, Magnanti and Orlin [1993] ) . In the shortest path 
tree, the unique path from node s to every other node is a 
shortest path. Hence, the network simplex algorithm finds a 
shortest path from node s to every other node of the network . 



Chapter 3 


CYCLE-CANCELLING ALGORITHM FOR THE MINIMUM COST FLOW PROBLEMS 


3.1 INTRODUCTION 

One of the most straightforward method for solving the 
minimum cost flow problem is the cycle cancelling algorithm. The 
algorithm repeatedly finds a negative augmenting cycle 
(equivalently, a directed cycle in the residual network G{x)) and 
cancels this cycle by augmenting maximum possible flow along the 
cycle . 

The cycle-cancelling algorithm is credited to Klein [1967] . 
The first polynomial as well as strongly polynomial 
cycle-cancelling algorithm is the minimum mean cycle -cancel ling 
algorithms due to Goldberg and Tar j an [1988] . Their algorithm 
repeatedly finds the minimum mean cycle in the residual network 
and cancels the cycle until an optimum solution is obtained, the 
algorithm runs in 0(n m min{log (nC), m log n}). A variation of 
this algorithm, which they call as the algorithm 
cancel -and- tighten, runs in 0({m log n min{log n C, mn log n}). 
Barahona and Tardos [1989] developed an algorithm, which 
repeatedly finds and cancels a collection of node-disjoint cycles. 
Their algorithm requires solving an assignment problem at each 
iteration, and runs in 0{n^ log imCU) (in+n log n) ) time. The third 
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type of cycle-cancelling algorithm is due to Wallacher and 
Zimmerman [1991] , which augment flows along minimum ratio cycles 
and runs in 0{nm^ log (nCU) ) time. Wallacher [1991] has 
generalized the idea of cancelling minimum ratio cycles and 
proposed different variants of this algorithm. Currently, the 
best available time bound for the minimum cost flow problem is 
0(min{nin log(n /m) log (nC), nmdog log 17) log inC) , m log n {m+n 
log n)}); the three bounds in this expression are, respectively, 
due to Goldberg and Tar j an [1987] , Ahuja, Goldberg, Orlin, and 
Tar j an [1992] , and Orlin [1988] . Even though none of the above 
cycle -cancelling algorithm match this time bound, their interest 
lie in the fact that they are simple and yet run in polynomial 
time . 


In this chapter, we propose two variants of cycle-cancelling 
algorithms. Our algorithms work with a feasible flow x and keep 
node potential 7 r{i) for every node i. We work with the residual 
network G{x) which has an arc {i, j) with cost c^j = c^. - ii{i) + 
n{j) and residual capacity - x^. for every arc (i, j) with x^. 
< and an arc (j, i) with cost -c”j and residual capacity for 
every arc (i, j) with 0. We call arcs with negative reduced 
costs in the residual network as eligible arcs, and the subgraph 
of the residual network consisting of eligible arcs as the 
admissible netvork. We say a node is reachable from node p if it 
has a directed path from node p. 

Our first cycle -cancelling algorithm uses capacity scaling.. 
It can be considered as the primal version of capacity scaling 
algorithms due to Edmonds and Karp [1972] and Orlin [1988] . The 
algorithm chooses an eligible arc with maximum residual capacity. 
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say arc (g, p) . We then find a shortest path from node p to node 
g in the residual network using only noneligible arcs with 
"sufficiently large" residual capacities; if the cycle consisting 
of the path and the arc (g, p) is negative, we augment flow along 
this cycle. We repeat this process until there is no eligible 
arc. The algorithm solves the minimum cost flow problem with 
integral supply/demands and capacities in 0(m log [7 (m + n log n) ) 
time, the same as that of the above mentioned algorithms. 

Our second cycle -cancelling algorithm uses a cancel 
subroutine of Goldberg and Tarjan's cancel-and-tighten algorithm 
[1988] and uses ideas such as e-optimality and fixing arc flows. 
The algorithm runs in 0(nm log n min{log(nC), m log n}) time. 
Each iteration starts with a acyclic admissible graph. We then 
sufficiently increase potentials of nodes reachable through 
eligible arcs from a node that has a most negative (eligible) 
incoming arc. Then the algorithm makes the new admissible graph 
acyclic using the cancel subroutine of Goldberg and Tarjan's 
algorithm. To make the algorithm strongly polynomial, it is 
to update the potentials at the start of an iteration 
applying a shortest path algorithm for nonnegative costs . Our 
algorithm differs from Goldberg and Tarjan's cancel-and-tighten 
algorithm in the following two aspects : 

(1) Updating potentials in each iterations is based on a 
different intuitive idea. Our algorithm finds a cut whose 
forward arcs are noneligible. Then the optimality violation 
of the backward arcs in the cut is shared with the forward 
arcs, improving the maximum optimality violation over all 
arcs in the cut by a factor of two; Goldberg and Tarjan's 



algorithm improves the maximum optimality violation over all 
arcs in the entire graph (e -optimality) by a factor of n. 

(2) To make the algorithm strongly polynomial, they solve a 
minimum mean cycle problem; we solve a shortest path problem 
with nonnegative costs. 

The organization of this chapter is as follows : 

In Section 3.2, we review some relevant definitions and 
results. In Section 3.3, we propose the cycle-cancelling 
algorithm with capacity scaling and present the analysis of the 
algorithm. In Section 3.4, we propose the algorithm 

cancel -and- share. We present both polynomial and strongly 
polynomial implementations of this algorithm along with their 
complexity analysis. 

3.2 THE BACKGROUND 

Our framework for discussion in this chapter is as follows. 
As usual, let G = (N, A) be a directed network with node set N 

containing n nodes and arc set A containing m arcs. We associate 
a cost and a capacity with every arc (i, j) € A. We 

associate with each node i e N a number b{i) which indicates its 
supply or demand depending on whether Jb(i)>0orJb(i)<0. We 
'assume without loss of generality that the minimum cost flow 
problem defined on this network has a feasible solution. We 
denote the largest magnitude of any arc cost by C, and the largest 
magnitude of any finite arc capacity by 17. 

The minimum cost flow problem has unbounded solution if and 
only if G has a negative (directed) cycle consisting only of 
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Since this can be detected by applying a 


uncapacitated arcs . 
shortest path algorithm, without loss of generality, we can assume 
G has no negative cycle consisting of uncapacitated arcs. We 
assume that, whenever arc (i, j) e A, arc (j, i) € A. 

The residual network 


Our cycle-cancelling algorithms work on the residual network. 
For a given flow x, we construct the residual network G{x) as 
follows. For each arc (i, j) e A with arc flow x.. < u. ., we 

2. J X J 

introduce an arc (i, j) in G(x) with residual capacity u. . - x. . 

^3 ^3 

and cost c. for each arc (i, j) € A with arc flow x. . > 0, we 
13 ij ' 

introduce an arc (j, i) in G(x) with residual capacity and 

cost Cj^ = -c^j. We denote the arc set of G(x) by il(x) , Note 
that A(x) = A'^vA' , where 

“ {{i/ 3 ) ’• (i/ j)eA, x^j < u^j} 

^ = {(-i/ j) : (j/ i)^A, Xjj^ > 0}. 

Each augmenting cycle in G with respect to a flow x corresponds to 
a directed cycle in G{x) , and vice versa (here we choose to ignore 
the cycles of the type (i, j)u(j, i) in G(x)). The cost of a 

directed cycle W in G(x) is defined as 


cW = I c.., 
{i,j)€W 


(3.1) 


and it is the cost of the corresponding augmenting cycle in G. 

Figure 3.1(b) gives the residual network for the flow on example 
network in Figure 3.1(a). 

Optimality Conditions 


The following well-known optimality conditions are funda- 
mental in the development of cycle-cancelling algorithms. 


The 




F4;ure3.1 Minimum cost flow problem: 

(a) Example netwoik. 

(b) The residual network fw flow in Figure 3.1(a) 
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proofs of these conditions can be found in Ahuja et al . [1993] . 

Theorem 3.1 (Negative Cycle Optimality Conditions). A feasible 
solution X is an optimal solution of the minimum cost flov problem 
if and only if the residual network G(x) contains no negative cost 
(directed) cycle. 

Theorem 3.2 (Reduced Cost Optimality Conditions). A feasible 
solution X is an optimal solution of the minimum cost flow problem 
if and only if some potential it satisfies the following reduced 
cost optimality conditions: 

c^j a 0 for every arc (i, J) in G(x), (3.2) 

where c^j = c^j - n(i) + n(j). 

Approximate Optimality 

A flow X is said to be e -optimal for some e > 0 if x, 
together with some node potential vector n, satisfies the 
following c-optimality conditions: 

c^j s -e for every arc (i, J) in G(x) . (3.3) 

The concept of e-optimality is due to Bertsekas [1979] and Tardos 
[1985] . 

We note that, for a flow x together with some node potential 
vector Tc, if -c denotes the value of the reduced cost of the most 
negative arc, then the flow x is e-optimal. For example, the flow 

on the exanple network given in Figure 3.1 is e-optimal, for e = 
18 and ir = 0. 
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all nodes which are not reachable from node p, we let d(i) - M, 
where M is an arbitrarily large positive real number greater than 
or equal to |c^ 1. This means d(i)'s are shortest distances from 

qp 

node p in the augmented graph obtained from G{x, r^^/2, n) by 
adding arcs (p, 1) for each node i with cost M. These d(i)'s 
satisfy + d[k) - d{k) a 0 for every arc {k, t) in the 

augmented graph, and hence also for every arc {k, 1) in G{x, 

r^^/2, Tt) . Therefore, without loss of generality, we refer to 
these d(i)'s as shortest distances from node p, and we assume they 
satisfy the shortest path optimality conditions. Let P denotes 
a shortest path from p to q in G{x, r/2, tt) found in the above 

A 

process. We update the potential n to n = u-d. It 0, we do 

qp 

nothing; otherwise, we cancel the cycle : = (q, p) u P by 

augmenting the maximum possible flow. Figure 3.2 presents an 
algorithmic description of the cycle-cancelling algorithm with 
capacity scaling. 

The justification for the algorithm is straightforward. 
Whenever q is not reachable from P in G(x, A, n) in an iteration, 
we have a 0 after updating n to n-d (since d(q) = M a: \c^\ 
and d(p) = 0) . Therefore, we would be able to find a shortest 
path from node p to node q if c^^ < 0. Note that the cycle W has 
the cost after the update. The algorithm terminates when 
a 0 for every arc (i, j) in G(x) , which implies (by reduced cost 
optimality conditions) that the flow x is an optimal flow. 

Analysis of the algorithm 

Each Iteration of the algorithm selects an eligible arc with 
the maximum residual capacity; we call this arc as the arc 



algorithm cycle cancelling vith capacity scaling; 
begin 

TT: = 0 

let X be a feasible integral flow; 

while there is an arc (i, j) with c^j < 0 do 

begin 

find an eligible arc (g, p) (i.e., c^p < 0) 
with the maximum residual capacity; 



find the shortest path distances d(i) to every 
node i from node p in G{x, A, n ) ; 

TT; = 7T-d; 

if c” < 0 then 
gp 

begin 

let P denote a shortest path from node p to 

pg 

node q in G{x, A, n ) ; 

, let 5 = min{r^j: (i, j) e (g, p) u ' 

augment 5 units of flow along the negative cycle 
W: = (g,p) U Pp^; 
update the flow x and G (x) ; 

end; 

end; 

end; 

Figure 3.2. Cycle cancelling algorithm with capacity scaling. 
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examined. We bound the number of iterations. Consider an 
iteration in which the arc (qr, p) is examined. Let G = G{x, 
r /2, n), where n is the potential and r is the residual 

qp Ht' 

capacity of the arc {q, p) at the start of the iteration. Let 

d{.) denote the shortest path distance from p to other nodes with 

respect to the arc cost c?j . By shortest path optimality 

conditions, (i) c^j + d(i) - d(j) a 0 for all arcs in G^, and (ii) 

c^. . + d(i) - d(j) = 0 for all arcs in the shortest path P from 
i J Ph 

node p to node q. The new potential at the end of the iteration 

^ TT 

is 71 = 71 - d; thus, the statements (i) and (ii) imply : (iii) c . . 

A IJ 

a 0 for all arcs in G^ , and (iv) . = 0 for all arcs in the path 


1 7T 

By definition, G contains all arcs in G(x) with c^j a o and 

choice of the arc (g, p) implies that . a o 

for all arcs in G{x) with r^j > and^these arcs are in so, 

by (iii) c^. a o for these arcs. When c"^ < 0, we augment flow on 

the cycle W: = { (g, p) }uP . As a result, the residual capacity 

of the reversals of the arcs in W increases. By the fact that c^ 

■'a pg 

> 0 and the statement (iv) , it follows that (v) . a 0 for the 

ij 

arcs in G(x’) wlwse residual capacity increases in the iteration. 
Consequently, c^ . a 0 for every arcs (i, j) in G(x') with r. . > r 
at the end of the iteration. Therefore, the residual capacity of 
the arc examined in the next iteration is at the most r 

<3P 

Repeating this argument inductively in the subsequent iterations, 
we conclude the following lemma. 


LeHHBa 3.2 ; The maximum residual capacity of the arcs violating 
optimality conditions at each iteration is nonincreasing. 



Now consider any arc (i, j) in . By definition of , c^j 

a 0 and j t beginning of the iteration. By the 

statement (iii) , j fc o at the end of the iteration. Extending 

the argument inductively for subsequent iterations, we conclude 

that (vi) the arc (i, j) may become eligible (i.e., c^j < 0) at 

the end of a subsequent iteration only if less than 

where {k, 1) is the arc being examined at this iteration. By 

Lemma 3.2, r. ,/2 s r /2 . 

kl qp 

A A 

We have either a 0 or < 0 at the end of the iteration 

QP QP 

at which the arc (g, p) is examined. In the later case the new 
residual capacity of the arc (g, p) is less than r ^^ /2 , since we 
augment at least F^gp/^l of flow along the cycle W. Note 

that units of flow augmented is integral. In the foanner case, 
when we have c < 0 at a siibsequent iteration, by the statement 
(vi) and the following observation, the new residual capacity of 
arc (g, p) at that iteration is less than or equal to • 

Thus, in both cases the residual capacity of the arc (g, p) is 
less than or equal to ^gp/2 st the first subsequent iteration at 
which <0. If the residual capacity of the arc (g, p) 

increases at a latter iteration by the statement (iv) , a 0. By 

repeating the argument, we conclude that if c^p < 0 at any 
subsequent iteration, the residual capacity of the arc (g, p) at 
that iteration is less than The arc (g, p) is again 

examined only when < 0. Hence we have the following lemma. 

^ PQ 

Lemma 3.3 : When an arc in G(x) is reexamined at an iteration, 
its residual capacity is less than or equal to half of its value 
when it vas examined previously. 
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Theorem 3.3 : The algorithm solves the minimum cost flow problem 
with integral are capacities in 0(m log U) iterations, where U is 
the largest capacity of arcs. 

Proof ; Since the starting flow is integral, the flow augmented 
at any iteration is integral; consequently, the residual 
capacities of the arcs in G(x) are integral. The residual 
capacity of an arc (Jc, 1) when it is examined for the first time 
is less than or equal to since is either or 

and 0 ^ x^^ s The arc (k, 1) is examined at most log = 

0(log U) times, since by Lemma 3.3, the (integral) residual 
capacity reduces to half its former value whenever it is 
reexamined. Since we consider at most 2m arcs in G(x) throughout 
the algorithm, the number of iterations is bounded by O (m log 17) 
time . P 

Each iteration of the algorithm selects an eligible arc (q,p) 
with the maximum residual capacity, which requires 0(m) time. 
Further, each iteration includes (a) solving a shortest path 
problem for node p to every node in N in the network G (x. r ^^ /2 tt) . 
(b) updating the potential tt, and (c) augmenting the flow along 
the cycle, W = (q,p) u ^pq' ® after updating the 

potential. By definition, - 0 every arc in G(x, r ^^ /2 . tt) . 
Thus, the operation (a) can be done by applying Dijkstra's 
algorithm for finding shortest path with nonnegative arc lengths. 
The implementation of the Dijkstra's algorithm due to Fredman and 
Tarjan [1984], runs in 0(m + n log n) time. Operations (b) and (c) 
require 0(n) time. Thus operation (a) dominates running time of 
all other operations in an iteration; therefore, each iteration 



runs in O (m + n log n) time. We have the following corollary by 
Theorem 3.3. 

Corollary 3.1 ; The proposed algorithm runs in 0((m log U) (m+n 
log n ) time. 

3.4 A CYCLE-CANCELLING ALGORITHM BY SHARING OPTIMALITY VIOLATION 

For a feasible flow x and potential n, we define the 
admissible graph as the subgraph of the residual network G{x) 
consisting of eligible arcs (i.e., arcs with < 0) . We call 

the (directed) cycles in the admissible graph as admissible 
cycles. Our algorithm uses the idea of cycle-cancelling 
algorithm, the algorithm cancel-and-tighten, due to Goldberg and 
Tar j an [1988] . We start with a feasible flow x and an arbitrary 
potential tt, which is by default 0. We cancel admissible cycles 
until the admissible graph becomes acyclic. We then try to create 
new eligible arcs in G{x) so that the admissible graph becomes 
cyclic; we do this by updating node potentials in a way backward 
arcs in a cut share their optimality violation with forward arcs 
in the cut . This process is repeated until an optimum solution is 
obtained. Our algorithm reduces e-optimality by a factor of at 
least 2 over a cut, whereas Goldberg and Tarjan's algorithm 
reduces c -optimality by a factor of at least n over the entire 
residual network. We obtain a strongly polynomial implementation 
by solving a shortest path problem with nonnegative costs, where 
they obtain a strongly polynomial implementation by solving a 
minimum mean cycle problem after every n iterations . Since both 
algorithms reduce e -optimality by a factor of at least two, in at 
most n consecutive iteration, both algorithms have the same time 
complexity. 
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we first find a feasible flow, and initialize the potential tt 
to 0; we also make the initial admissible graph acyclic. We then 
choose a most negative (eligible) arc (g, p) m G(x) and find the 
set of nodes S reachable from node p through eligible arcs. Let s 
= N-S; S 4> since the admissible graph is acyclic. Thus [S, s] 
is a cut in G{x) . Let (S, S) denotes the set of forward arcs in 
the cut [S, S] and (S, S) denote the set of backward arcs in the 
cut [S, S] . Note that p e S and g e S. Let e = ~^qp’ update 
7 r(i) to 7 t(i) + c/2 for every node i e S. As a consequence, (i) 
the reduced cost of every arc in (S, S) reduces by c/2, and (ii) 
the reduced cost of every arc in (S, S) increases by c/2. Note 
that, by construction of the cut [S, S] , the arcs in (S, S) are 
noneligible (i.e., & 0) before updating the potential ti. 
Updating potential n may create new eligible arcs in (S, S) while 
keeping at least the arc (g, p) in (S, S) eligible. Thus, by 
updating the potential in the above manner, we try to create new 
eligible arcs by sharing the optimality violations of eligible 
arcs in (S, S) with (noneligible) arcs in (S, S) in a balanced 
way. We call this process as the procedure share. 

We identify a most negative arc in G(x’) by associating a key 
to every node in N. We define in-key (i) of a node i as the 
reduced cost of a most negative incoming arc to node i in G(r) ; if 
there is no negative incoming arc, then in-key (i) = 0. Let 
in-key(p) = min{in-key (i) : ieN) . Thus, in-key(p) is the reduced 
cost of a most negative arc in G(x') . Note that for some node (}, 
the arc (g, p) is a most negative arc in G{x) . Let c = " 
in-key (p) . We refer to the node p as the node examined at the 
iteration. Once the node to be examined is identified, the algo- 



rithtnic description of the procedure share is given in Figure 3.3. 


procedure share {x, n, p) ; 
begin 

c = -in-key (p) ; 

find the set of nodes S reachable from node p through 
eligible arcs in G(x) ; 
for every node i e S do 
71 (i) : = 71 (i) + e/2; 

end; 


Figure 3 . 3 The procedure share 

Updating potential n by the procedure share may create cycles 
in the admissible graph. We make the admissible graph again 
acyclic by repeatedly finding and cancelling admissible cycles. 
Then we find the node p such that a most negative arc is an 
incoming arc to node p. We call this process as the procedure 
cancel, whose algorithmic description is given in Figure 3.4. 

procedure cancel {x, tt. p) ; 
begin 

repeatedly find and cancel admissible cycles until the 
admissible graph become acyclic; 

recompute in-key of every node and find the node p such that 
in-key (p) = min{in-key (i) : i e W}; 

end; 

Figure 3 . 4 The procedure cancel . 

Our algorithm repeatedly performs the procedure share and the 
procedure cancel until the optimal solution is obtained. We first 



describe the algorithm for integral arc costs, which is given in 
Figure 3.5. 

algorithm cancel -and- share; 
begin 

Ti: = 0 and X be any feasible flow; 

cancel (x, n, p) ; 

while in-key (p) s -l/n do 

begin 

share (r, n, p) ; 
cancel {x, n, p) ; 

end; 

end; 


Figure 3.5 Cancel and share algorithm 

Figure 3.6 illustrates the first iteration of the 
cancel -and- share algorithm for the flow on the example network 
given in Figure 3.1. Since n = 0, c^j = c^j for every arc (i, j) 
G(x) (See Figure 3.1(b)). The initial admissible graph consists 
of arcs (1, 3), (2, 4), (4, 1), (5, 1), and (5, 4), and is 
acyclic. Number shown in square brackets by the side of each node 
is the in-key. Since node 1 has the minimum in-key (note that (5, 
1) is the most negative arc) , it is the node to be examined at the 
first iteration (node 1 is enclosed by a square bracket) . The 
procedure share finds the set S = {l, 3} of nodes reachable from 
node 1 through eligible arcs, and increases the potentials of 
these nodes by -in-key (l)/2 = 9. Figure 3.6(a) shows the reduced 
costs after the update. The admissible network in Figure 3.6(a) 
is cyclic. Figure 3.6(b) shows the resultant residual network 




F^re 3.6 lUiistratiop of an ilmtion of the alg<»itbm cancel-and-sbaie on Example 3.1. 
(a) Procedme sbaie . 

Prooeduie cancel 



after the procedure cancel is applied. At the end of the 
iteration, node 1 is again selected for examination at the next 
iteration. 

Analysis of the algorithm 

Recall that in-key (p) of the node p at the beginning of an 
iteration is the reduced cost of a most negative arc. Thus, for c 
= -in-key (p) , the flow x is e-optimal. At the termination of the 
algorithm, the flow x is c -optimal for e < l/n since in-key (p) > 
-1/n. By Lemma 3.1, the flow x is an optimal flow. 

We need the following lemmas to bound the number of 
iterations. 

Lemma 3.4 : Cancelling admissible cycles does not decrease the 
in-key(i) of any node. 

Proof ; Cancelling the flow on an admissible cycle adds only arcs 
with positive reduced costs to the admissible graph. Hence the 
lemma follows. 

■ 

Lemma 3.5 ; Let node p be the node examined at an iteration. Then 
(a) at the end of the iteration, in-hey(p) increases to at least 
half of its value at the beginning of iteration; and (b) if 

in-key(i) of any node i decreases, it decreases at least to 
in-key (p)/2. 

Proof : Let s denote the set of nodes reachable from node p 
through eligible arcs in G(x) . Updating the potential n in the 
procedure share increases the reduced cost of arcs in (S, S) (the 
backward arcs in the cut [s, s] ) by e/2 where 


e = -in-key (p). 



since the admissible graph is acyclic, the tail nodes of all 
incoming eligible arcs to node p lie in S. For, if g e S for some 
eligible arc (g, p) then there is a directed path from p to g 
consisting of eligible arcs which forms a admissible cycle 
together with (g, p) which is a contradiction. This implies that 
all incoming eligible arcs are in the set (S, S) . As a 
consequence, in-key (p) increases by c/2. 

Updating potentials decreases reduced costs of arcs in (S, S) 
(the forward arcs in the cut [S, S] ) by e/2. Since before the 
update c^j ^ 0 for every arc (i, j) in (S, S) by the construction 
of the set S, the reduced cost of any arc (i, j) is at least -cj2. 
Consequently, keys of the nodes in S can only decrease, and if 
they do, they decrease at least to -c/2. 

Now the lemma follows from Lemma 3.4 and the fact that 
in-key {p)= -c. ■ 

Lemma 3.6 : After at most n consecutive iterations of the 
algorithm^ the reduced cost of the most negative arc in G(x) (the 
in-key of the node examined) increases to at least half of its 
original value. 

Proof : Let in-key (1^)= -e, where i^ is the node examined at the 
beginning of n consecutive iterations under consideration. Since 
in-key (i^) is the reduced cost of the most negative arc, in-keys 
of all other nodes at least -c . 

Let Q denotes the set of nodes whose in-keys are less than 
-c/2 at the beginning of these iterations. By Lemma 3.5(b), no 
node is added to Q after the first of these iterations. Further, 
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-c . 


in-key of the node examined in the next iteration at least 
Repeating this argument for subsequent iterations, we conclude 
that (a) no node is added to Q in subsequent iterations; and (b) 
in-key of the node examined in subsequent iterations is 
non-decreasing. By Lemma 3.5(a) , the in-key of the node examined 
increases to at least half of its original value at the beginning 
of an iteration; this implies, by conclusion (b) , that at least 
one node is removed from Q at each iteration. Since Q consists of 
at most n nodes, after n consecutive iterations, Q will be empty. 
The lemma follows immediately. ■ 

Theorem 3.4 ; The algorithm cancel- and- share solves the minimum 
cost flow problem with integral costs in 0(n log(nC)) iterations. 

Proof ; At the initial stage of the algorithm, since tt = 0, the 
most negative arc in G(x’) has reduced cost at least -C where C is 
the largest cost . By Lemma 3.6, the reduced cost of the most 
negative arc in G(x) increases at least to half of its original 
value in at most n consecutive iterations. Hence, after n { flog 
nCj+l) = 0(n log (nC)) iterations, the reduced cost of the most 
negative arc is greater than or equal to -c/2 s -i/n. 
Therefore, the resulting flow will be an 1/n-optimal flow. From 
our discussion at the beginning of our analysis, this is an 
optimal flow. 

A strongly polynomial implementation 

The algorithm cancel -and- share runs in strongly polynomial 
number of iterations if we update potential n using a shortest 
path algorithm before cancel -and- share procedure at every 
iteration. We define . = max(0, c^.-) as the arc length of every 



arc (i, j) in G(x), and we find the shortest path distance d(i) 
from node p being examined to every node i e ff. Then we update 
the potential n to n-d. If in-key (p) < 0 after update, share and 
cancel procedures are applied. We call the above updating pro- 
cedure as adjust -potential, and the algorithm as enhanced cancel - 
and-share. The algorithmic description is given in Figure 3.7. 

algorithm enhanced cancel -and- share; 
begin 

TT: = 0 and let x be any feasible flow; 
cancel {x, n, p) ; 
while in-key (p) < 0 do 

begin 

adjust -potential {x, n, p) ; 
share (x, n, p) ; 
cancel (x, n, p) ; 

end; 

end; 

Procedure adjust-potential {x, n, p) ; 
begin 

find shortest path distance d(v) from node p to every 
node V e N using arc lengths max (0, c^j) > 

It: = Tt-d; 

compute in-key (p) ; 

end; 

Figure 3.7 (a) The enhanced cancel -and- share algorithm. 

(b) The procedure adj ust -potent ial . 
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Figure 3^ fflustration of an iteation of the algorithm enhanced cancel-and-share on Example 3.1. 

(a) diortest distance using arc loigths (0, ). 

(b) reduced cost after the procedure adjust-potmitial. 

(c) reduced cost aft^ the procedure share 

(d) The residual network after the procedure cancel. 



Figure 3.8 illustrates the first iteration of the enhanced 
cancel-and-share algorithm for the flow on the example network 
given in Figure 3.1, Figure 3.8(a) gives shortest distances d(.) 
from node 1 obtained using arc cost (0, • The procedure 

adjust-potentials updates the current potentials (which are zero) 
TT ( . ) to TT ( . ) - d ( . ) , Updated potentials and the new reduced costs 
are shown in Figure 3.8(b) . Since key(l) = -8 is still negative, 
we apply share and cancel subroutines. Figure 3.8(c) shows the 
potentials and reduced costs after the procedure share is applied. 
The set of nodes S enclosed by a rectangle is the set of nodes 
which are updated in the procedure share. Figure 3.8(d) shows the 
residual network after the procedure cancel is applied. 
Comparison with Figure 3.6 shows that adj ust -potential , in effect, 
modify the reduced cost so that incoming eligible arcs to node 1 
lie in a negative cycle whose cost is less than or equal to the 
reduced cost of the arc. For example, arc (5, 1) has reduced cost 
-2 which is the cost of the cycle 1-(1, 2) -2- (2, 5) -5- (5, 1)-1. 

Lemma 3.7 : Updating potential by the procedure adjust-potential 
does not decrease the key of any node. 

Proof ; Let d (v) denotes the shortest distance from node p to node 
V using arc lengths max(0, . • By shortest path optimality 

conditions 

max(0, c^j) +d{i) -d{j) & 0 for every arc (i, j) in G{x) (3.4) 

The statement (3.4) can be restated as the following two 
conditions . 

c^j+dii)-d(j) 0 for every arc (i, j) in G{x) with c^j s: o (3.5) 
d(i)-d(j) & 0 for every arc (i, J) in G(x) with c^j < 0 (3.6) 
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Since the new reduced cost after update are cjj + d(i) - d(J), the 
statement (3.5) implies that all non-eligible arcs remain non- 
eligible after the update; the statement (3.6) implies that the 
reduced cost of every eligible arc is non-decreasing. Therefore, 
the lemma follows from the definition of in-key. H 

The consequence of Lemma 3.7 is that the results in Lemma 3.5 
and Lemma 3.6 also hold for the enhanced version of the algorithm. 
Further, we can replace in-key (p) in Lemma 3.5 by in-key (p) after 
the procedure adjust-potential. 

We now consider two consecutive iterations of the algorithm 
enhanced cancel -and- share at which node is examined. That is, 
in these iterations node has a most negative arc as an incoming 
arc. Let the number of iterations between these two iterations be 
k-1. Let Pq, p^, P 2 , •••. Pji denote the in-keys of nodes 

examined at the beginning of these iterations, starting at the 
first iteration in which node was examined and ending at the 
second iteration in which node is again examined. Let p^, p^, 
Pjj denote the in-keys of nodes examined in these 
iterations after the procedure adjust-potential in which we update 
the potentials by shortest path distances. By Lemma 3.7, Pi - Pi 
for 0 s i < k. By Lemma 3.5 (also see the remark at previous 
para), at the end of first iteration, in-key (i^) increases at 
least to Pq/ 2, and in subsequent k-1 iterations, if it decreases, 
it decreases at least to pj./2. Therefore, when node is 

examined again, its in-key Pj^ a min{p^/2 : 0 £ i s kj or 2pj^ ^ 
: 0 s i s k-l}. But p, = c^, where node p is the node 

-t 2 qp 

examined at the corresponding iteration, and n is the potential 
and (g, p) the most negative incoming arc to node p after the 



procedure adjust -potential applied. Consider the shortest path 
Ppq using arc length = max (0, cjj) , where n is the potential 
before the procedure adjust -potential is applied. Since n = n-d, 
where d represents the shortest path distances using arc lengths 
cj- .. Hence, for every arc (i, j) in . + d{i)-d(j) = 0 

which implies c’Jj- 0. Therefore, the cost of the cycle W: - 
P _u{(g,p)}, C(W) = I = I s = p Let p = 

min{p^ : 0 s i s k-l} and W denotes the corresponding cycle as 

defined above. Then, c(W) p < 2pj^, where p^ is in-key (i^) at 
the beginning of the second iteration at which node is examined 
again. 


In (n+1) consecutive iterations of the algorithm, at least 

one node is examined twice. Let this node be node in the above 

discussion. Thus at a stage in these (n+1) consecutive iterations 

G(x) has contained a cycle W such that C(V) s ^p^, where Pj^ is the 

key(i ) when it is examined for second time. Since the key of the 
o 

node examined is non-decreasing, Pj^ is less than or equal to the 
key of the node examined at the beginning of the (n+l)th 
iteration, which is by definition, the reduced cost of the most 
negative arc. Thus, we have proved the following lemma. 

Lemma 3.8 : Let -c be the reduced cost of the most negative arc 
at the beginning of (n+l)^^ iteration of a set of (n+1) conse- 
cutive iterations of the algorithm. Then, at one of these (n+l) 
iterations, G(x) has contained a cycle vith cost at most -2c. 

We define an arc to be e-fixed if the flow on the arc is the 
same for all -optimal flows for s e. The following theorem 
is due to Tardos [1985] and Goldberg and Tarjan [1988] . 
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Theorem 3.5 (Goldberg and Tarjan (1988)) : Let c > 0. Suppose a 
flov X is c-optimal vith respect to a potential n, and suppose 
that for some arc (K, 1) e A, ^ 2ne, then arc (k, 1 ) is 

c-fixed. 

We apply the above theorem to prove the following result . 

Theorem 3.6 : Let x be a flov and suppose G(x) contains a 
(directed) cycle V vith mean cost -c, c > O. Suppose a flov x^ is 
c^-optimal and 2n s e. Then, there is an arc (k, 1) e W vhich 
c^-fixed. 

Proof : Let n denote potential for which the flow is 

e^-optimal, i.e., c^j a -c^ for every arc (i, j) in . Since 

the mean cost of W is -e, there must be at least one arc (k, 1) in 

Gix ), which is either an arc or the reversal of an arc in W, 

having Ic^jl ^ e. Since 2ne^ s e, we have ^ 2ne^. By 

Theorem 3.5 we obtain that arc {k, 1) is -fixed. 

Theorem 3.7 : For the minimum cost flov problem vith real valued 
costs, the algorithm enhanced cancel-and-share performs 0(mn log 
n) iterations. 

Proof ; Let K = n 2 flog n”] + (n+l) . We divide the iterations 
performed by the algorithm into groups of K consecutive 
Iterations. We claim that each group of iterations fixes the flow 
on an additional arc. Since the algorithm can fix flows on at 

most m arcs, the algorithm performs at most K = 0(mn log n) 
iterations . 

consider the first (n.l) iterations in a group. Let -e 
denote the reduced cost of the most negative arc at the beginning 



t It. 

of (n+1) iteration. By Lemma 3.8, at some stage of these (n+1) 
iterations, G{x) contained a cycle with cost at most -2c, The 
mean cost of this cycle at most -2c/n = -e^ (say) . Each n 

consecutive iterations of the remaining iterations, by Lemma 3.6, 
increase the reduced cost of the most negative arc to at least 
half of its original value. Then, the reduced cost of the most 


negative arc at the end of this group -e^ 2: 


-e 


-e 


,2 [log n 1 2 log n 


— g 

= — 2 * Consequently, at the end of the group, we have a flow 


n 


which is e^-optimal, and s e/n^ = c^/2n, i.e., 2nc^ s c^, 

where is the mean cost of negative cycle in G{x) at some stage 

of these iterations. Thus, by Theorem 3.6, at least one arc in 

this cycle is c -fixed. Since the reduced cost of the 

most -negative arc is non- decreasing, the flow obtained in 

3 3 2 

subsequent iterations are e -optimal for c s e . Hence the flow 
on this arc remains unchanged. 


Complexity Analysis 

The running time of each iteration is dominated by the time 
taken by the procedure cancel, which cancels admissible cycles 
until no admissible cycles are left. We use Goldberg and Tarjan's 
[1988] method to cancel admissible cycles. The method uses 
depth-first search. Each search advances only along eligible 
arcs . Whenever a search retreats from a node i , this node is 
marked as being on no admissible cycle. A search is allowed to 
visit only unmarked nodes. Whenever a search advances to a node 
it has already visited, an admissible cycle has been found. The 
cycle is cancelled and a new search begins. Goldberg and Tar j an 
[1988] describe two implementations of the above method. The 
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straightforward implementation runs in O {nm) time. The 

implementation using a dynamic tree data structure (Sleator and 
Tarjan [1983, 1985], Tarjan [1983]) runs in 0(m log n) time. 

The procedure adjust -potential requires solving a shortest 
path problem which can be implemented in 0(ni+n log n) time 
(Fredman and Tarjan [1984]). Other operations in an iteration, 
updating potentials, updating the keys of nodes, and finding the 
node with minimum key can be done in 0{jn) time. Thus we can 
implement each iteration in 0(m log n) + Oim+n log n) + 0(m) = 0(jn 
log n) time. By Theorem 3.4, the algorithm performs 0 (n log (nC)) 
iterations for integral data. By Theorem 3.7, the algorithm 
performs 0(n m log n) iterations for arbitrary real-valued costs. 
Thus we obtain the following theorem. 

Theorem 3.8 ; The algorithm enhanced cancel-and-share solves the 
minimum-cost flov problem in 0(n m^(log nf) time for arbitrary 
real-valued arc costs, and in 0(nm log n min{log(nC), m log n}) 
time for integral arc costs. 



Chapter 4 


ARC TOLERANCES IN NETWORK FLOW PROBLEM 


4.1 INTRODUCTION 

Sensitivity analysis is a well-established area in operations 
research, in particular, for network and linear programming 
problems . The versatility of network programming needed the 
sensitivity analysis in its own right and a good body of research 
has been done in this direction. In this chapter, we address the 
sensitivity of cost functions associated with arcs in the network 
flow problems. 

The sensitivity results provide useful information to the 
managerial decision making such as break-even selling price of a 
new product. Since there is always some uncertainty in data, it 
also provides a measure of robustness of optimal solution under 
small variation in data. Further, when the model appears as a 
subroutine in more complex problems, they provide useful 
information to perform the next step. The usefulness of 
sensitivity analysis Ccua be gauged from the fact that every 
commercial network programming software, which may be a part of a 
linear programming system, provides sensitivity results as a part 
of standard output. 
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Hundreds of articles have been written on sensitivity 
analysis for linear programming . The book and the survey paper by 
Gal [1979, 1984] provides a comprehensive review on this topic. 

The sensitivity analysis is also an essential part in standard 
linear programming books, see, for example, Bradely et al. [1977] 
and Murthy [1976] . In linear programming, the sensitivity of a 
variable (activity) is estimated by the range in which cost 
coefficient (price) of the variable can vary, with all other cost 
coefficients xmchanged, while keeping the current basis optimal. 
Values in this range are called as basic support prices 
(Ben-Israel et al. [1989]); we refer to this interval as basic 
tolerance interval . 

When the given optimal basis is degenerate, the range in 
which cost coefficient of a variable can vary, with all other 
cost coefficients unchanged, while keeping the current basic 
solution optimal is larger than the basic tolerance interval 
(which keeps the current basis optimal) . We call this interval as 
the tolerance interval . Values in this interval are known as 
support prices (Ben-Israel et al [1989]). The tolerance interval 
contains all basic tolerance intervals corresponding to the 
current basic solution; they coincide when the given basis is 
nondegenerate. However, tolerance intervals are not easier to 
calculate from the local data. We call the end points of a 
(basic) tolerance interval as -(basic) tolerance limits or simply 
(basic) tolerances . 

Srinivasan and Thompson [1972] specialized sensitivity 
results of linear programming to the transportation problem. They 
apply so called basis preserving cell operators to calculate basic 



tolerances. Shier and Witzgal [1980] studied basic tolerances of 

an arc for the minimum cost flow problem (they call basic 

tolerances subtracted from the cost co-efficients as arc 

tolerances) . It should be noted that the transportation problem 

and the minimum cost flow problem are equivalent models (see, for 

example, Ahuja et al. [1993]) . In both the above articles, basic 

tolerance intervals of arcs are determined as follows. Let n be 

the node potential corresponding to the given optimal basis (which 

is a tree of the given network) . Let (p, q) be a non-basic 

(non-tree) arc. If its flow is at its lower (upper) bound, then 

its basic tolerance interval is [tt (p) -rr (g) , «] ( [-«, tt (p) -Tt(g) ] ) ,- 

this result is a straight forward application of the corresponding 

result for linear programming (see, for example, Murthy [1976] ) . 

Now consider the case of basic (tree) arc (p, g) . Let IS, S] 

denote the cut obtained by deleting the arc (p, g) from the basis 

tree such that p 6 S, g e S. Then the basic arc tolerance 

interval is [c - c^, c + c,], where e- (e.,) is the minimum of 

pg 2 pg 1 12 

absolute values of reduced costs of forward arcs at its upper 
(lower) bound and backward arcs at its lower (upper) boxind in the 
set [S, S] - { (p, g) } . 

Shier and Witzgall [1980] also presented an algorithm to 
compute basic tolerance intervals for all arcs. Computation for 
non-tree arcs are straight forward and takes overall 0{m) time. 
They compute basic tolerance intervals for tree arcs as follows. 
They choose a leaf node (node with degree 1) in the basis tree; 
let (p, g) or (g, p) be the arc in the basis. The basic tolerance 
interval of this arc is computed by scanning the forward star A (p) 
and backward star B(p) of node p. Then this arc ( (p, g) or (g, p) ) 
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is contracted and the process repeated for the basis tree in the 
contracted graph. The algorithm runs in O(n^) time. Using 
advanced data structures, Gusfield [1983] and Tarjan [1982] 
presented algorithms which run in 0(in log n) and 0(nt oc(nt, n) ) 
time, respectively, where oc(itt, n) is a functional inverse of 
Ackermann's function (See Tarjan [1982]). 

Ravi and Wendell [1988] have considered arc tolerances in 
which arc costs (as well as other data) are perturbed 
simultaneously and independently; the results are specialization 
of Wendell's [1985] results for linear programming. We do not 
consider simultaneous arc tolerances in this chapter . 

Optimal basic (spanning tree) solutions to network flow 
solutions often have high degree of degeneracy. For example, 
dynamic networks for the vehicle allocation problem studied by 
Powell [1989] have been found to have 40-80% degenerate basic 
(tree) arcs (that is, flows on these arcs at are either upper or 
lower bounds) . Further, most of the combinatorial algorithms do 
not produce basic optimal solutions. In view of the above facts, 
it is imperative to consider arc tolerances which preserves the 
optimality of a solution instead of basic arc tolerances . Fong 
and Srinivasan [1977] and Powell [1989] have studied the problem 
of determining nondegenerate shadow prices (node potentials and 
reduced costs of arcs) . 

Ahuja et al. [1993] treats unit change in an arc cost 
combinatorial ly which can be extended for more general changes. 
Rockafellar [1984] discuss sensitivity analysis for the separable 
convex cost flow problem. 



In this chapter, we characterize arc tolerances by shortest 
non- singleton augmenting paths or, eguivalently, shortest 
non-singleton path in the residual network. A non-singleton path 
is a path consisting of more than one arc. Extending the scope, 
we present our results for the more general separable convex cost 
flow problem; the analysis and the algorithm remain the same as 
that for the minimum cost flow problem. We present an algorithm 
which uses reoptimization to find shortest non-singleton paths 
between all pairs of nodes immediately giving tolerance intervals 
for all arcs. The algorithm runs in O(n^) time in array 
implementation, and in 0{im + n log n) time in Fibonacci heap 
implementation. Compared to earlier results of Srinivasan and 
Thompson [1972] and Shier and Witzgall [1980] , we compute 
tolerance intervals instead of basic tolerance intervals; our 
analysis can be applied to any optimal solution (not necessarily 
any basic optimal solutions) and to the more general separable 
convex cost flow problem. 

The outline of the chapter is as follows. 

In Section 4.2, we give the formulation for the separable 
convex cost flow problem and review some necessary definitions. 
Then, we present two well-known optimality conditions for the 
separable convex cost flow problem. Finally, we define the 
tolerance interval of an arc for the separable convex cost flow 
problem consistent with the definition of arc tolerance interval 
for the minimum cost flow problem. In Section 4.3, we present the 
theory which characterizes tolerance values by shortest 
non- singleton paths in the residual network. In Section 4.4, we 
present an algorithm to find shortest non- singleton paths between 
all pair of nodes. 



4.2 THE BACKGROUND AND THE PROBLEM FORMULATION 


In this section, we state the separable convex cost flow 
problem and formulate the problem to be studied in this chapter. 

The separable convex cost flow problem is defined on a 
directed network, G = (W, A) . Here N is a set of nodes and .A is a 
set of arcs. Each arc (i, j) e A has an associated real-valued 
convex cost function which gives the cost for the flow 

x^. on arc (i, j) . We also associate with each arc (i, j) e A a 
capacity (also called upper bound) that denotes the maximum 

amount of flow that can be sent on the arc and a lower bound 1^^ 
that denotes the minimum amount of flow that must be sent on the 
arc. We associate with each node i e N a real number b{i) 
representing its supply/demand . If b(i) > 0, node i is a supply 
node; if b(i) < 0, node i is a demand node with a demand of -b(i); 
and if b(i) =0, node i is a transshipment node. The decision 
variables in the separable convex cost flow problem are arc flows 
and we represent the flow on an arc (i, j) e A by The 

separable convex cost flow problem (SCCF) is formulated as 
follows : 

Minimize £ (4.1) 

sixbject to 

I X.. - Z X.. = b{i) for all i e N, (4.2) 

{j:{i,j)6A} {j:{j,i)6A} 

Ifj s x^. S for all a, J) e A, (4.3) 

A 

where J] b(i} =0. We denote the objective function by C(x)t 
i=l 

i.e., C {,x) = J ‘ 



Marginal Costs 


Consider an arc (k, 1) e A. Let x be a flow and denote 
the corresponding arc flow on arc (k, 1) . The right marginal cost 
of ik. 1), with respect to the arc flow is the right 
derivative of the arc cost function at and we will 
denote it by simply by . Thus, 
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(4.4) 


Similarly the left marginal cost of arc {k. 1) (with respect to 
^kl^ ' "^^^^^hed by ^kl' left derivative of 

^kl ^^kl ^ ^kl ' ^ ® • ' 
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(4.5) 


Cost of Augmenting Cycles and. Paths 

Consider an augmenting cycle W with respect to a flow x. The 
orientation of the cycle W is the direction along which the flow 
is augmented. Let W denote the set of arcs in W on which the flow 
is increased and V denote the set of arcs in W on which the flow 
is decreased. We define the cost C(W) of the cycle W as the rate 
of change in the objective function as we augment the flow along 
the cycle W. Note that when we augment © > 0 units flow along the 
cycle W, the flow changes to x^^ + © on arcs in W, and x^. - © on 
arcs in W; the flow remains the same on all other arcs. Thus, 



C(V) = Limit 
©—^0 


L (i,j)€W 


Cj. (X...©) - C..ix..) 
© 


+ I _ 


© 


From (4.4) and (4.5), we have 


CiW) = I - i: c:,{3F,,). 


(i, j) eW 


(i,J)€W 


ij ij- 


(4.6) 


Consider an augmenting path P with respect to the flow x. Let P 
denote the set of arcs in P on which the flow is increased and P 
denote the set of arcs in P on which the flow is decreased. In a 
similar way the cost of an augmenting cycle is defined. We define 
the cost C(P) of the path P as the rate of change in the objective 
fimction as we augment the flow along the path.P. ' Thus, 


C{P) 


E _ 

(i, j) eP 


Cl.(x..) 


E 

UrJ)€P 


c:.(iE..) 


(4.7) 


The Residual Network for Separable Convex Cost Flow Problems 


Let X be a feasible flow to SCCF. The construction of the 
residual network G = (N, .4(r)) is similar to the construction of 
the residual network for the minimum cost flow problem except for 
arc cost. For every arc (i, j) € A with x^j < u^j, we introduce 
an arc (i, j) in A{x) with residual capacity r.j = - Xj^j and 

cost c^j = for every arc (i, J) ^ A with x^j > we 

introduce an arc (j, i) with r . . = x.. and cost c.. = -cT.(x..). 

ji ij ij 

Let 


A(X) = .4'^(x)u^“ (x). 


(4.8) 



where 


Further, 


ij 


A 

C - 


{(ifj) : (i. 

J) 

€ A and x^. < 

(4.9) 

{(ifj) : (J, 

i) 

6 A and Xj^ > Ij . } . 

(4.10) 


if 

(if j) e A''’(x) 

(4.11) 

^Ji 

if 

(i / j) e A~ (x) 


if 

(i, j) e .A‘^(x) 

(4.12) 


if 

(i, j) e A~ (x) 


The network G{x) contains cycles of the type i - (i, j) - j - 
Ui -i) " -i ■ = (if j)'j(jf i) / if the flow lies in between the 

bounds, i.e., l±j ^ call these cycles as trivial 

cycles, since these cycles represent zero flow augmentation on the 
corresponding arcs. Recall that, for the minimum cost flow 
problem, c^j = c^. for (i, j) e A (x) and (i/ J) ® 

a" (x) . 


1 

We note that any augmenting cycle V with respect to the flow 
X corresponds to a directed cycle W in G(x ) ; the directed cycle V 
is a non-trivial cycle (i.e., is not a trivial cycle), and is 
obtained by reversing the arcs in on which the flow is 

decreased. Conversely, any non-trivial directed cycle W in G{x) 
corresponds to an augmenting cycle in G. The cost of a 

directed cycle Jff in G(x) is defined by 

cm = Z c.. (4.13) 

(l,j)6W 

Thus, by construction, W and its corresponding cycle have the 
same cost, i.e., C(W) = C{Iir^) . Henceforth we mainly work with the 



residual network, since it simplifies the discussion and it is 
equivalent to working with the original network. 

4.2.1 Optimality Conditions 

We now present two optimality conditions, which are necessary 
for our analysis. These results are well-known, (for example, see 
Rockafellar [1984] ) , but for the sake of comoleteness, we give the 
proofs in our terminology. See also Iri [1969] for related results. 

Let X be a feasible flow. For any augmenting cycle W with 
respect to the flow x, we define its incidence vector e 2?”* as 
the vector having 1 for the co-ordinates corresponding to the arcs 
in W, -1 for the co-ordinates corresponding to the arcs in V, and 
0 for others. Then x + 0 is the flow obtained by augmenting e 
units along the cycle V. Thus, by definition 

c(x + e Cj^) - c{x) 

C(W) = Limit , e a 0. (4.14) 

© — »0 © 

Let y be any other flow. Then y-x is a feasible circulation in 
G(x) . By the flow decomposition theorem (see, for example, Ahuja 
et al. [1993]), y-x can be decomposed into at most m cyclic flows 
on S(x) . That is, the flow y can be obtained from the flow x by 
at most m cyclic augmentations. Hence, for some y s m, © > o for 

JHl, 

every 1 s k £ z , and 
y 

y-x = I e e (4.15) 

k=l "• "k 

We define a vector e R® as follows. 



Then 



C^^y-x) = I e, C{V.) (4.16) 

k=l " ^ * 

From the convexity of the function C^.{x^.) (see Jan van Tiel 
[1984, Theorem 1.6]; also see Rockafellar [1970, Chapter 23]), we 
have 


C . - (y . .) 

ij ^^ij' 



'^1 j'-^i j> , 

(4.17) 

c . . (y . .) 




(4.18) 


Adding the left hand side and the right hand side of the 
inequalities (4.17) corresponding to the arcs (i, J) with > 

x^j and of the inequalities (4.18) corresponding to the arcs (i, 
j) with y. . < X. and adding the terms C. .(y. .) and C". .(x. .) for 
the arcs (i, j) with y^. = x^j to the resultant right hand and 
left hand sums respectively, we have 

C(y) ^ C{x) + C^{y-x). (4.19) 

Thus, by (4,16), we have 

7f 

c(y) c(x) + I e. c(i?.). 

k=l ^ ^ 

We are now in a position to prove the following optimality 
conditions . 

Theorem 4.1 (Negative Cycle Optimality Conditions) : A feasible 
flov X to SCCF is optimal if and only if G contains no negative 
augmenting cycle W with respect to the flov x ( etpiivalently , the 
residual network G(x) contains no negative cycle). 



Proof. Necessity : Let be an augmenting cycle with respect to 
the flow X. Then x + 6 is a feasible flow for some 0 > 0, and 
for all 0 > 0 such that x + 0 is feasible. By the optimality 
of the flow X, we have 

C(x + e e ) a Cix), 

C{x + e e ) - C(.x) 

Consequently, Limit s 0. 

0-^0 0 

Therefore, by (4.13), c{V) ^ 0. 


Sufficiency : Let y be any arbitrary feasible flow and C{w) > o 
for any augmenting cycle ff. Then, from (4.15) and (4.19), there 


exists augmenting cycles ..., and 6^ ^ 0, for all 1 s i 


7 f ^ m such that 


y = X + I e.e 
ft=l ^ 


C(y) a C(x) + I e. C(v. ). 

k=l ^ ^ 


By assumption, C{Wj^) a 0. Since 0^ > 0, we have C(y) C(x) . 
Hence x is an optimal flow. 


The optimality conditions in Theorem 4 . 1 are equivalent to 
the optimality conditions given in Rockafellar [1984, pp. 435]. 
We derive the following optimality conditions, which are 
equivalent to the optimality conditions given in Rockafellar 
[1984, pp 382], using Theorem 4.1. 


Tlieorem 4.2 (Reduced Cost Optimality Conditions) ; A feasible 
flov X to (SCCF) is optimal if and only if there exists a 
potential n satisfying the following conditions ; 



(4.20) 


in 


0 for erery arc Ci, J) in G(x), 


where c^j are the costs as defined by (4. 12), and 


cjj = c^j - n(i) + n(j) 


Proof : The sufficiency of the conditions (4.20) is straight 
forward. Note that, for any directed cycle W in Gix) , 


cm 


E 

(i, 



E 

{iJ)eW 



since 7r(i)'s in the second sum cancel out. Consequently, the 
conditions in (4.20) imply CiW) a 0 for any cycle V in G{x) . 
Hence, by Theorem 4.1, the flow x is optimal. 


Necessity. We augment the network G{x) to G{x) by adding node s 
and connecting the node s to every node i e N by an arc (s, i) 
with cost 0 . In the network G (x) , every node i has a directed 
path from s. Further, by assumption that x is optimal, the 
network contains no negative cycle (Theorem 4.1); consequently, 

A 

G{x) contains no negative cycle since the new arcs do not 
introduce any directed cycle. The above properties imply that the 
shortest path distance d(i) for each node i e N from node s exists 
and it is finite (see Ahuja et al. [1993, Sections 5.2 and 5.3]). 
Further, they satisfy the following conditions: 

A ^ 

d{j) s d(i) + c^j for every (i, j) in G(x) . (4.21) 

A ^ 

Let n = -d. Then c^j ^ 0 for every (i, j) in G(x) . Since G(x) is 
a sxobgraph of G (x) , the necessity follows . ■ 


Note that, by construction of G(x) , Gix) contains an arc (i, 
j) with cost C. -ix..) for every arc (i, j) e A with 


and 



an arc (j, i) with cost for every arc (i, j) € A with 

> l^j- (Henceforth we will assume, without loss of generality, 
lower bounds l^jS are zero). Therefore, the reduced cost optimality 
conditions are the same as the following optimality conditions: 


7r{i) - nij) s for every arc (i, j) e A 


with x^j = 0 . 


(4.22a) 


Clj(x^j) £ 7r(i) - 7T(j) S Ctj^x^j) for every arc (i, j) e 

with 0 < x^j < (4.22b) 


^ 7r(i) - 7r{j) 


V (i, J) 6 ,4 


with 


(4.22c) 


4.2.2 Arc Tolerance Analysis 


We investigate the following problem in this chapter. How 
much the cost function associated with an arc can be perturbed 
without changing the arc flows in a given optimal flow to SCCF. 
We will perturb the cost functions of an arc one at a time, 
holding all other cost functions, supplies /demands and capacities 
constant. We refer to this problem as Arc Tolerance Analysis . In 
this section, we develop a combinatorial theory for arc tolerance 
analysis to SCCF, which is based on the negative cycle optimality 
conditions given in Theorem 4.1. 


We call a real -valued convex function on R as a valid 
perturbation of the convex function associated with an arc in SCCF 
if the given optimal flow remains optimal when we replace the 
latter by the former in the objective function. To be more 
precise, let x be an optimal solution to the original problem and 
Ik, 1) and ^kl be the arc under consideration and its cost 



function, respectively. Then, a real valued convex function 
^ valid perturbation of if x remains optimal 

when we replace objective function. 

It is clear from the construction of the residual network 
G(x) and the negative cycle optimality conditions that the factors 
associated with the arc (k, 2) which influence the optimality of 
the flow X are only the marginal costs of C^i^x^^i) at . In the 
next section, we show that there is a closed interval [a^2' 
such that a convex function is a valid perturbation of 

if and only if at least one of the marginal costs of 
^kl falls in the interval ^kl^ ’ call this 

interval as the tolerance interval of the arc (k, I) in SCCF. 


The tolerance interval of an arc in SCCF, by definition, 
characterize effectively all the desired perturbations of the cost 
function associated with the arc. In MCF, the desired 
perturbations are restricted to linear functions. In this case, 

^kl^^kl^ ~ ^kl^^kl^ ~ ^kl' tolerance interval for (k, 1) 
in MCF is the interval in which cost coefficient can vary, 
while keeping the optimality of a given solution. 


4. 3 THEORY 


In this section, we develop a theory to evaluate the 
tolerance interval for each arc in A for a given optimal flow. In 
the following discussions in this chapter, we denote the given 
optimal flow to SCCF by x and its residual network by G(x) . 

Let (k, 1) denote an arbitrary but fixed arc which is 

considered for finding the tolerance interval. Let 



any convex function replacing Thus, the new perturbed 

cost function is 

eu) = I o^Ax.j) * 

{i,j)eA 

By definition, ^ valid perturbation if the flow x is 

optimal with respect to C(x) . Let G be the network obtained from 
g(x) after deleting the arcs {k, 1) and (1, 7c) if they are present 
in G(x) . From the construction of G{x) , we have 

, G u { (1, 7i) }, if = 0; 

G(x) = - Gu {(7c, 1)}, if Xjjj = 

‘ Gu {(7c, 1),(2, 7c)} if 0 < •^ 1^2 ^ ^Tcl ’ 

By the negative cycle optimality conditions, G(x) contains no 
negative cycles. Further, after the perturbation, the cost of 

arcs (Tc, I) and (1, 7c) in G(x) change to C^2^^7cl^ ~^kl^^kl^ 

respectively, costs of all other arcs remain intact. These two 
facts lead to the following observations. 

Property 4.1 ; (a) G contains no negative cycle. (b) If, after 

the perturbation, G(x) contains a negative cycle, then the cycle 
consists of either arc (7c, 1) or arc (1, 7c) . 

If a minimum cost cycle containing an arc is non-negative, 
then any cycle containing the same arc is non-negative. Thus 
Property 4.1(b) implies the following property. 

Property 4.2 : After the perturbation, G{x) contains no negative 
cycles if and only if the following statements hold : (a) T^y 
mininmm cost cycle consisting of arc (7c, 1) in G(x) has 



and only if ^ a 0 if 

+ a. (1) a 0 if (1, k) is in g(x) . 

K. 

and (1, k) is in Gix) if > 


[k, 1) in Gix) , and ■®w 
But ik, 1) is in Gix) if 
0. Hence the lemma. 


) 


Note that a shortest path from node k to node 1 in G is a 
shortest path from node k to node 1 excluding the single arc path 
k-{k,l)-l in Gix), which in turn is a shortest augmenting path 
from node k to node I in G excluding the path k-ik,l)-l or the 
path k-(l,k)-l. For this reason we call the distance as the 

non-singleton shortest augmenting distance from node k to node 1. 
Recall that the tolerance interval ^kl^ 

definition, the interval with the property that a convex function 

C ix } is a valid perturbation if and only if at least one of 
kl ^kl 

Cj^llxj^l) and lies in this interval. The following 

theorem gives the tolerance interval . 


Theorem 4.3 : Let a^(l) and a^(k) denote the non-singleton 

shortest augmenting distances vith respect to the flow x (or 
equivalently j the non-singleton shortest distances in G(x)) from 
node k to node 1 and node 1 to node k respectively. Then the 
tolerance interval ^kl^ 1) is given below : 


^^kr ^kl^ 


if x^^ = 0; 


[-a^(k), 

[-aj^(k), 3^(1 if 0 < 


if Xj^j^ 


(4.23) 


Proof I Since, by Property 4.3, -3^ (Ji) s 3^(1), ’ ^kl^ 

empty in all three cases in (4.23). Further, by convexity of 



sufficiency : When both and belong to 

conditions (a) and (b) in Lemma 4.1 are satisfied in all 
three cases, namely, Xj^j^ = 0, == 0 < • Hence 

^ valid perturbation. Suppose only belongs 

to [“jc 2 ' ^kl^ ’ Then Sj^(k) £ ^kl^^kl^ ^ 

inequality (4.24) implies that ^ -dj (ft) for the case 0 < 

^jj2 ^kl' ^ valid perturbation. The cases 

= 0/ •^^2 ~ ^kl straight-forward. The arguments for the other 

possibility that only belongs to ^kl^ similar. 

Necessity ; When both C^^Cxj^j) and outside (a^^, 

^kl^ ' at least one of the conditions in Lemma 4.1 is violated. 
Therefore , ^kl is a valid perturbation. ^ 

4.4 ALGORITHM FOR FINDING NON-SINGLETON SHORTEST PATHS 

In Section 4.3, we have shown that the tolerance interval of 
an arc (k, 1) can be immediately calculated, once we know 

non-singleton shortest distances and 3^ (k) in G(x) (Theorem 

4.3) . Since G{x) contains no negative cycles, but contains 
usually many negative arc costs, we can find tolerance interval 
for all arcs by applying a label correcting shortest path 

algorithm (such as Bellman and Ford algorithm) 0{m) times. The 
best (strongly) polynomial time bound for any label correcting 
algorithm is 0(nm) [see, for example, Ahuja et al. [1993] for more 
details] . This straight-forward method is highly inefficient, 
since the overall complexity for computing all relevant 

non-singleton shortest distances is 0{nm ). In this section, we 
improve this complexity significantly in two ways : 
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(i) By working with an optimal node potential. 

(ii) By reoptimization. 

Working with an Optimal Node Potential 


The reduced cost optimality conditions (Theorem 4.2) 

A. 

guarantee that there exists a node potential tt such that c^j > o 
for all arcs in G(x) . We call such a potential as an optimal 
potential. The following property shows that working with costs 

^71 ^ 

c^j is equivalent to working with . (recall that we use 
the notation c^j to denote the cost of arc (i, j) in G{x)) . 

Property 4.4 ; For any (directed) path P from node k to node 1, 


I = I c. . 


{n{k) - nil)) 


Proof : The summation c^j = c^j - n{i) + jtij) over arcs in P 

cancels out all 7i(i)'s except n(l) and -Tt{k) . ^ 

Property 4.4 implies that one could work with 's to find 

shortest distance from node k to node I and then add n{k) - nil) 
to get the shortest distance with respect to the original costs 

A 

Thus, if we denote the non-singleton shortest distance from 
node p to node q by 3^ (q) , then 

3p(q) = 3p(g) + nip) - 7r(g) (4.25) 

We often get a node potential n satisfying c^j s 0 for every 
(1, J) in G{r) , as a by-product of solving SCCF. Otherwise, we 
use the procedure applied in Theorem 4.2 to find such a node 
potential. The procedure has the following three steps. 



(i) Augment the network G{x) by adding a node s to G(x) and 
connect this node to every node i by an arc (s, i) of 
cost 0 . 

(ii) shortest distance d(i) from node s to every node i 

augmented network by applying a label correcting 
shortest path algorithm. 

(iii) Let 71 = -d. 

The step (ii) dominates all other steps. This step requires 
applying a label -correcting shortest path algorithm which, as we 
pointed out at the beginning of this section, requires Oima) time. 
We call this procedure as procedure potential-initialization. 

Finding a Shortest Path Tree 

Once we have optimal potentials at hand, we proceed as 
follows. We choose a node p and apply Dijkstra's algorithm to 

— ■*'77 

find a shortest tree from node p in G(x) using arc costs c. .. 

P 

The path from node p to any node i in is a shortest path from 

node p to node i , and we denote the corresponding shortest 

distance by d^(i) . 

P 

Dijkstra's algorithm maintains at any intermediate step, a 
directed out -tree T at the (root) node p, spanning a set of node S 
for which the shortest distances are already found. The labels 
d(i) for nodes in S = N-S give the distance of a shortest path to 
node i passing through nodes only in S. A node i with minimum 
label in S is chosen and added to S and labels of nodes adjacent 
to j are updated. Since we use this iterative process for 
reoptimization, we give its algorithmic description in Figure 4.1. 
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procedure Di jkstra' s; 
begin 


while ISl < INI do 
begin 

let i e S be a node for which = min{dp(j) : j 6 s} 

S = S u{i} ; 

S = S - {i}; 

for each (i, j) € ^(i) do 

if dp{j) > d^(i) + c^j then d^(j) : = d”(i) + c^j 
and pred(j) = i; 


end; 

end; 


Figure 4.1 


At the end of the algorithm, for each node i , the predecessor 
index of node i, pred(i) gives the predecessor node j of node i in 
the final shortest path tree; predip) = 0. 


Constructing Tree Indices of Tp 

Using indices predii) ' s we construct other tree indices, 
namely, depth index and thread index of each node i e N, denoted 
by depth(i) and thread(i) (see Section 2.2). First we build 
adjacency list of each node i in T^, denoted by SUCC(i), by 
examining predii) of each node (i) . Then applying breath- first 
and depth-first search in using SUCC(i)'s, we construct depth 
indices and thread indices , respectively. The procedure takes 0(n) 
time. For more details, see Ahuja et al. [1993] . We shall see 
below that these indices are needed for efficient reoptimization. 



The Reoptimization Procedure 


We first point out that the tree path in from p to all 
nodes except for those in SUCC(p) are non-singleton shortest 
paths. To find a non-singleton shortest path from p to node <j in 
SUCC(p), we delete the arc (p, q) from as well as from G{x) ; as 
a result all relevant information, pred{i)'s and d^{i)'s, become 
invalid only for nodes in D{q) , the set of all descendants of node 
q. We regain this information by applying Dijkstra's algorithm 
starting at the stage where only nodes in D(q) are temporarily 
labeled. Since we need the data of the tree for applying this 
procedure to other nodes in SUCC (p) , we will not disturb these 
data; we will store the new distances in a new array, nsd(i) . If 
we need actual path, we will also store the new predecessor index 
as nspredii) for i e D(q) such that q e SUCC ip) . Note that, for 
each node i, nsd(i) denotes the shortest distance from node p to 
node i when arc (p, q) is deleted. 

We initialize the label nsdij) for each node j e D{q) as 
follows : 

nsd(j) = min {d^[i) + : (i, j) e B(j) : i e W-D(g)} 
where B{j) is the backward star of node j. 

To perform this process efficiently, we first mark nodes in 
D(q) ; we do this by tracing thread {i) starting from node q until 
the depth of node next traced at least is equal to that of node q 
(we use depth indices) . Then, we again visit nodes in Diq) one by 
one using thread indices, and scan their backward star to initia- 
lize nsdij) for each j e Diq), The algorithmic description of this 
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procedure, named setup-potentials (Z)(g) ) is given in Figure 4.2. 

procedure set up-pot entials(D(q) ); 
begin 

mark (g) : = g ; nsd (g) = » ; 

k: = thread(q); 

while depth {k) < depth (q) do 

mark (k) = qt lisd(k) : = “ and k: = thread {.k) ; 

for each (i, g) e B{g) do 

if mark(i) * q and nsdiq) > d^d) + c^j then 
nsd(g) : = crp(i) + c^j and nspred(q) : = i ; 
k = thread {q); 

while depth {k) < depth (g) do 
begin 

for each (i, k) e B{k) do 

begin 

if mark(i) * q then 

if nsd(k) > dp(i) + c^^.then 

nsd(k) : = d”(i) + c^. and nspred(k) : = i; 

P ij 

end; 

k; = thread (k) ; 

end; 

end; 

Figure 4.2 

We now apply Dijkstra's algorithm's iterative loop (see 
Figure 4.1) taking S = N-D(q) as the initial set of permanently 
labelled nodes; for i e D(g), we use the label nsd(i) instead of 
<^(i) . At the termination of the iterative loop, nsd(g) is the 
non-singleton shortest distance from p with respect to costs c^j • 



The justification follows from the correctness of Dijkstra's 
algorithm. When the arc {q, p) is deleted, the shortest distance 
for each node i e N-D(q) = s remains the same. The 
procedure setup-potentials initializes the distance labieXs nsdd) 
to the shortest distance to node i passing through only nodes in S 
= N-D(q) in the graph G{x) - { (p, q)}, for each node i € D(q) . 
Thus we can apply Dijkstra's algorithm taking S = N-D{q} as the 
initial set of permanently labeled nodes. Hence, at the 
termination of reoptimization process, nsdiq) is the shortest 
distance in G(x) - { {p-q) } , that is, the non-singleton shortest 
distance from node p to node q. 

We now analyze the complexity of the reoptimization process. 
We refer to the reoptimization process done after deleting the arc 
(p, q) as reoptimization { (p, q) ) . It has two steps : 

(i) setting initial potentials for nodes in D{q) ; 

(ii) applying Dijkstra's algorithm on the graph G{x) - { (p, g) } 
taking S = N-D{q) as the initial set of permanently labeled 
nodes . 

For step (i) , marking nodes in D(g) takes lD(g)| time; 

scanning the backward star of each node in D(g) takes 

of E lB{i)|ltime. Thus, the complexity of step (i) is 

^ieD(q) •' 

of E lB(i)|1 time. In step (ii) , scanning forward stars of 
'^ieDCg) i 

nodes in D(q) takes of E IF{i) I ] time. Selecting the node with 

^ieD(q) ■' 

the minimum distance label takes 0{|I>{g)l) time, if we store 
nsdii) 's of nodes in D{q) in an array (we can use thread indices 
to scan the nodes in Die) only); hence, this takes 0(10(5“) I ) in 



total. Alternatively, we can use Fibonacci heaps [see Chapter 2, 

section 5] to store nodes in Diq) with keys nsd(i)'s. Since 

nsd{i) are non- increasing, we use decrease-key operation to update 

nsd(i)'s when we scan forward star of the node selected. To 

select a node with minimum nsd(i) , we use find-min and delete-min 

operations. Since, in Fibonacci heaps, decrease-key and find-min 

takes 0(1) time, and delete-min takes O((log |D(g)l) time (|J)(g)| 

is the maximum number of elements in the heap at any stage of the 

algorithm) , the time taken in Fibonacci heap implementation for 

step (ii) is of E (IF(i)l + lD(g)l log iD(g)l) ]. We summarize 
^ieDiq) 

this discussion in the following lemma. 

Lemma 4.2: The procedure reoptimization^ Cp, q)) runs in 

of E (lF(i)l-hlB(i)l) + \D(q)\^] time in the array 

implementation and in of E (\F(i)\ + \B(i )\ )+\D(q)\log( \D(q)\ )\ 

'^ieD(q) ’ 

time in the Fibonacci heap implementation. 

The Main Algorithm 

Having developed the required subroutines already, we can 
describe the algorithm for computing non- singleton shortest path 
between all pair of nodes. 

We assume that right and left marginal costs of each arc are 
given or can be computed in 0(1) time. The algorithm has 
following steps : (i) find an optimal potential n, if it is not 

available; (ii) for each node p e N, find non-singleton shortest 
distances from p to all other nodes using arc costs 
using the formula, 

3^(i) = 3”(j’) + n{i) - n{j) 



calculate non- singleton shortest distances between all pair of 
nodes . 

The step (ii) consists of following steps for each node p: 
(iia) find a shortest path tree from node p to all other nodes 
(using Dijkstra's algorithm); (iib) build -tree indices, thread and 
depth, for the tree (iic) for each q e SUCC(p) , use procedure 
reoptimization (p, q) , to find non-singleton shortest distance 
3p(q’) from p to node q. Recall that, for nodes not in SUCC(p), 
the unique tree path in is not only the shortest but also 
non- singleton. 

The steps of the algorithm are self explanatory, except for 
reoptimization ( (p, q) ) (in step (iic)) for which we have already 
given the justification. Step (i) (finding an optimal potential) 
requires 0(nm) time. Step (iii) requires O(n^) time. 

We now analyze the complexity of step (ii) for one node, say 
p; multiplying this complexity by n gives the complexity of step 
(ii) . 


Using Dijkstra's algorithm, finding a shortest path tree 
(step (iia)) requires 0(n ) time in array implementation, and 
0(m-t-n log n) time in Fibonacci heap implementation (see, for 
example, Ahuja et al. [1993]). Building tree indices for (step 
(iib)) requires 0(n) time. In step (iic), we apply procedure 
reoptimization ( (p, q) ) for each node q e SUCC(p) . 

By Lemma 4.2, procedure reoptimization ( (p, g) ) requires 

of I ,( |B(i) | + |F(i) I) + ll>(g)l^| time in array implementation, 

^ieD(g) ^ 

and of X (IB(i)l + IF(i)l + II>(g)l log IB(g)l) ] time in 
^ieB(g) 
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Fibonacci heap implementation. Note that U D{q) = W-|p] 

g€SUCC(p) ^ 

Thus summing the expression J] (|B(i) + |F(i)l) over all g 

UDiq) 

SUCC(p) , we get the bound £ (|B(i) + IF(i)l) = m + m = 0[m). 

ieW 

Similarly the summation of |B(g) 1^ over all q in SUCC(p) gives 

0{n^) bound. (Here we use the property that if a. , a-, . . . , a, 

k K 

2 2 

are positive integers, then (a^ + a 2 + • • • + > _E a^ and the 

fact £ lB(g) I < n.) Summation of the term lB(g)| log 

geSUCC (p) 

{iB(g)I), since log ll)(g) I < log n, gives the bound 0(n log n) . 
Thus, summing respective complexity bounds for procedure 
reoptimization (p, g) given in Lemma 4.2, we get the complexity of 
step (iic) for a node p as 0(m+n ) and 0(m+n log n) in array and 
Fibonacci heap implementations, respectively. Since the 

complexity of this step dominates the complexity of all the other 
steps, the time complexity of step (ii) for node p is O(n^) in 
array implementation and 0{m+Ti log n) in Fibonacci heap 
implementation. Hence, step (ii) (over all nodes) requires O(n^) 
in. array implementation and 0(nin + n^ log n) in Fibonacci heap 
implementation. Since this step dominates the bound for step (i) 
and step (iii) , the algorithm runs in O(n^) time in array 
implementation, and Oiiun + n log n) time in Fibonacci heap 
implementation . 

We summarize the discussion in the following theorem. 

Theorem 4.4 : The algorithm given in this section finds 

non-singleton shortest distance in G(x) betveen all pairs of nodes 
• 3 

in 0(n ) time in array implementation, and in 0(nm + n^ log n) 
time in Fibonacci heap implementation. 



Apart from the storage requirement for the initial data, for 

every node p, we need an additional n-dimensional array for 

storing each of the following data : distance labels d^{i) , 3p(i), 

three indices pred(i) , depth (i ) , thread (i ) . Thus, over all nodes 
2 

we require 0{n ) additional storage. 

Theorem 4.4 together with Theorem 4.3 implies that one can 
find tolerance intervals of all arcs in a network for both minimum 
cost flow (MCF) and separable convex cost flow (SCCF) problems in 
0{n ) time in array implementation, and in 0{jiin + n log n) time 
in Fibonacci heap implementation. 

Example 

Consider the example network in Figure 4.3(a) with the given 
flow shown on the arcs; the (convex) cost functions associated 
with arcs in Figure 4.3(a) are tabulated in Figure 4.3(b). The 
given flow is an optimal flow for SCCF problem defined on Figure 
4.3(a) for the cost functions given in Figure 4.3(b). The 
residual network G(x) for the flow x is given in 4.3(c); a set of 
optimal node potentials are shown alongside of nodes. 

Figure 4.4 illustrates the computation of the non-singleton 
shortest path distance 5^(2) in G{x) from node 1 to node 2. 
Figure 4.4(a) shows a shortest path tree from node 1. Node 2 
is in SUCC(l) (that is, a successor of node 1). Therefore, we 
apply the reoptimization procedure. We first delete the arc (1, 
2) . Then we apply the procedure setup-potentials to initialize 
distance labels for node in D(2) ; these labels denote the shortest 
distances to nodes in D(2) passing only through nodes in N-D{2) 
using arc lengths c^j. Figure 4.4(b) shows these labels. Then we 
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Figure 3 (a) An example network with an optimal flow 

(b) (convex) cost functions associated with each arc 

(c) The residual network with optimal node potentials. 
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Figuie4.4 (a) Shortest padi tree jGrom node 1 with initial shortest distance with respect to 

(b) Shortest distance labds in G(x) - (1, 2) (nsd's) after the procedure set-iq> poeotials. 

(c) a nonsingleton hottest path from node 1 to node 2. 
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apply the Dijkstra's algorithm, with K-D(2) as permanently labeled 
nodes. The figure 4.4(c) shows a resultant non-singleton shortest 
path from node 1 to node 2. The non-singleton shortest distance 
a^(2) (with respect to arc length Plj) is 2. By Equation 4.25, 
the son-singleton shortest distance aj^(2) - a^(2) + n(l) - ir(2) . 

2 + 7 - 3 = 6. 

By applying similar procedure, we find ^2^^^ ” hence 

3 (1) =1 + 3 -7 = "3. ThsrBfore/ by Th603r8TU 4.3/ th6 tolsrance 

interval of arc (1, 2) is ~ i 3q^(2)] - [3, 6], 

Hence any convex function ^^2 ^^12^ ^12 least one of its 

marginal costs and interval is a valid 

pgx-furbat ion . Note that when the function is of linear type, 
i.e., it is a valid perturbation if takes any value in 

[3, 6] ; this is the cost sensitivity analysis in the traditional 


sense in the minimum cost flow problem. 



Chapter 5 


INVERSE LINEAR PROGRAMMING AND NETWORK FLOW PROBLEMS 

5.1 INTRODUCTION 

The well known, widely used linear programming problem is 
to minimize linear (cost) function over a given system of linear 
constraints (polyhedron) on J?"*. The cost objective function is 

m jn 

represented by the vector product cx = c e R and 

X € r'" . The vector c is referred to as the cost (vector) , Cj as 
the cost coefficient of the variable Xj. On the other hand, 
suppose c is a priori estimated cost and x is a feasible solution 
of the given system of linear constraints, say P. Let t denote 
any arbitrary cost for which x is the minimum cost solution over P 
(that is, the cost function tx attains its minimum at x over P) . 
We refer to such a cost (vector) as conormal to P at x. Given x e 
P, we call the problem of finding a conormal (to P at x) , whose 
'variance' from the priori estimated cost c is minimum as the 
inverse linear programming problem (ILP). Note that we can take t 
= 0 as the solution to the above problem when there is no 

'variance' objective, which has no meaning. When the given system 
of linear constrains is a system of flow conservation equations 
and flow bound constraints defined on a directed graph, we call 
the corresponding ILP as the inverse netvorK flow problem (IF). 
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one can interpret the given solution x e P as the observed 
solution of the system P. 

we measure variation of a vector t from the cost c by a real- 
valued function k(t-c), satisfying the following properties ; 

(i) k{0) = 0 and t ^ 0 k{t) > 0 , 

(ii) kU^ + t^) s K(t^) + k{t^) , 

(iii) k(Xt) = X kit) for X > 0. 

^0 refer to a function k with above properties as an unorni and 
ji{t.-c) as the k-vsrisncc Thus an ILP is minimizing' a k-variance 
from the priori estimated cost c over all conormals to P at x. 
Since the conormals to P at x are the cost for which x is optimal, 
ILP is about perturbing a priori estimated cost to a minimum 
k-variance conormal for which an observed solution of the given 
system becomes a minimum cost solution. The difference between an 
LP and ILP is that while LP determines a minimum cost solution of 
• a linear system of constraints, ILP infers a conormal to the given 
solution of a linear system of constraints with minimum 'variance' 
from the given cost. 

Burton and Toint [1992] studied inverse (multiple source) 
shortest paths problems; the problem is to find minimum least 
square variance nonnegative arc costs from a priori estimated cost 
such that the given set of (observed) paths become shortest paths 
with respect to the newly determined cost . They later 
investigated (multiple source) shortest paths problems in which 
the cost coefficients of arcs in given disjoint subsets are 
linearly correlated (Burton and Toint [1994] ) . Here we point out 
that inverse (multiple source) path problem without any 



constra-ints on a^rc costs is a special case of ILP and inverse 
(single source) shortest paths problem without any constraints on 
arc costs is a special case of IF. Burton and Toint's work is 
mainly focused on developing algorithms for inverse shortest path 
problems specializing Goldfarb and Idnani's [1983] dual algorithm 
for strictly convex quadratic programs. Their motivation for 
studying inverse shortest paths problems is due to its 
applications both in transportation research and computerized 
tomography. In the first case, the question was to recover travel 
costs as perceived by netvrork users from the knowledge of their 
actual route choices. The second example aimed at reconstructing 
the wave speeds in a discretized medium based on their paths in 
this medium. 

In this chapter, we study the duality of inverse network flow 
problems. Mainly, we show that duals of inverse network flow 
problems with respect to standard variances such as Euclidean, 
weighted rectilinear and weighted maximum variances are standard 
network flow problems . We also characterize solutions and the 
optimal values whenever possible. 

For this purpose, we first develop the duality theory for 
inverse linear problems from duality results in convex analysis. 
We mostly adopt results from the book "Convex Analysis" by 
Rockafellar [1970] . Applying this theory for inverse network flow 
problems, we show the following results: 

(i) The optimal solutions to Euclidean inverse network flow 
problem (EIF) and its dual give a decomposition of the given 
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vecto 3 r c ; ths dual is squivalsnt to a quadratic (strictly convsx) 
cost flow problem. 

(ii) The dual of weighted rectilinear network flow problem (WRIF) 
is a minimum cost flow problem. For the rectilinear network flow 
problem, a minimum cost arc-disjoint augmenting cycles corresponds 
to an optimal solution of the dual . 

(iii) The weighted maximum inverse network flow problem and the 
maximum inverse network flow problem are equivalent to solving 
minimum cost-to-weight ratio augmenting cycle problem and minimum 
mean augmenting cycle problem, respectively. 

(iv) The dual of weighted rectilinear inverse spanning tree 
problem is a transportation problem and the dual of rectilinear 
inverse spanning tree problem is an assignment problem. 

In Section 5.2, we review definitions and certain results 
from convex analysis. We develop the duality theory for inverse 
linear programming in Section 5.3. We consider inverse network 
flow problems in Section 5.4. In Section 5.5, we study inverse' 
spanning tree problem. 

5.2 PRELIMINARIES 

A subset S of r”* is convex if (l-A)x + Xy e S whenever x e S. 
y e S and 0 < X < 1. A convex set K is a convex cone if Xx e K 
whenever x e K and X > 0. The convex cone K(S) generated by a 
convex set S is defined as the set ; 


K{S) = { Xx|x € S, X a 0 } 



Its translate 

S+a = { x+al X e S }, a e F^, 


and the scalar multiple 

XS= { A.xl X e S }, X>0, 


of a convex set S are convex. The symmetric reflection of S 
across the origin is -S = (-l)S. A convex set is said to be 

symmetric if S = -S . 


A subset If of jR"* is called an affine set if {1-X)x + Xy e M 
whenever x e M, y e M and X e R. The affine hull of a set S, 
denoted by af f S, is the set of all vectors of the form + • • • 

+ Xy^y^, such that e S, i = 1, 2, . . . , k, and + ••• 

The Euclidean norm of x e R*" is, by definition. 


II ^ ■ ( jii ' ). 


We 


shall denote by B the Euclidean unit ball in R*” , that is. 


B = { x| II X II s 1 }. 

A set S in R*** is bounded if S c XB for some X e R. 

For any set S in R™, the closure cl S and interior int S can 
be defined as the following sets : 

cl S = { x| (x+eB) n S * <l> tor every e > 0 }, 
int S = { x| for some e > 0, x + eBcS }. 

The relative interior ri S of a convex set S is the interior o 
when S is regarded as a subset of its affine hull aff S. 
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the set ri S of S is defined as the set : 


ri S = { x e aff S| for some € > 0, [x+cB) n ( aff S ) c s) 

A convex set C is said to be relatively open if ri C = c, and 

closed if cl C = C. Note that int S can be empty even when ri s 
is non-empty. When int S * (p, int S = ri S. We call y as an 
interior points of S if y 6 int S. 

Let f be a function whose values are real or ± w and whose 
domain is a subset S of . The function f is convex if 

f((l-X)x + Ay) < (l-X)a + XjS, 0 < X < 1, 

whenever f (x) < a and f iy) < /S. Suppose f takes values only in 
(-«, +«) , Then f is convex on a set S in fi”* if 

f((l-X)x + Xy) £ (1-X) fix) + Xf(y), 0 < X < 1, (5.1) 

whenever x e S and y e S . The effective domain of a convex 

function f on S, denoted by dom f, is the set : 

dom f = { x| f (x) < « ) . 

A convex function f on R is said to be proper if its values are 
real or +« and fix) is finite for at least one x. A convex 
function f is said to be closed if {x|f(x) £ a} is closed for 

every a e R. 

The conjugate f iy) of a convex function fix) in j/” is 
defined by 

f iy) = Sup I xy - fix) (5.2) 

X6R^ ^ ^ 


Let s be any non-empty convex set. The polar S° of S is defined by 
S * { ylxy £ 1 for every x e S }. (5.3) 



When K is a non-empty convex cone, the definition of polar K° of 
K reduces to the one given below : 

= { y| xy s 0 for every x € K }. (5.4) 


S. 


We associate the following convex functions to a convex set 
The indicator function S{x\S) of S is defined by 


5(x|S) = J 


0 if X e S, 
+00 if X « S. 


(5.5) 


The support function 5*(y|S) of S is defined by 

5*(x|S) = sup{ xyl y e S }. (5.6) 

The gauge function y(x|S) of S is defined by 

y(xlS) = inf{ X a: 01 X e XS }, S * (p. (5.7) 


We call a real valued function k(t) as an unorm if - it satisfies 
the following properties : 

(i) k{0) - 0, and k(t) >0 for every t * 0. (5.8) 

(ii) k(Xt) = X7i(t) for every X > 0, every t. (5.9) 

(iii) k{t^+t^) £ k{t^) + kit^) for every t^, t^. (5.10) 

An unorm k(t) is obviously a convex function. When an unorm k{t) 
satisfies k(t) = k{-t) for every t, then it becomes a norm. 

The polar J£° (y) of ajj unorm k{t) is defined by 

k°{y) = inf {ti & 01 yt s Mk(t) for every t}. (5.11) 


The above formula can also be written as 



In the following proposition, we collect some useful results 
from Rockafellar [1970] for future reference; we refer to the 
corresponding result in the above reference along with each 
result . 

Preposition 5.1 : Let k be an unarm and fc° be its polar. Let 

R = {tlkft; £ (5.13) 

and R° = {y\k°(y) s i>. (5.14) 

Then^ 

(a) k(t) = r(t\R)j k°(y) = T((y\R^). The set R and R^ are uniquely 
defined closed bounded convex sets containing the origin as its 
interior pointy and they are polar to each other (Theorem 15.1, 
Theorem 14.5, Corollary 14.5.1). 

(b) k(t) = 8 (tlR°)j k^(y) - S^(y\R) (Theorem 14.5) 

(^) ^ (y) = S(y\R°) (Theorem 13.2). 

A set P of vectors in R is called a (convex) polyhedron if 
P={x\Axsb}, 

where A is a nxm matrix and b e R^ . When Jb = 0, the polyhedron P 
is a polyhedral cone. 

5.3 INVERSE LINEAR PROGRAMMING PROBLEM 

Let X be the observed solution to a system P of linear 
constraints; that is, let x be a point in a polyhedron P. Let k 
be an unorm, and c be the priori estimated cost vector in 
The inverse linear programming problem (ILP) is to find a vector t 
such that k variance k{t~c) attains its minimum at t over the set 



of all vectox t with the ptoperty that the linear function -tx 
attains its minimum over P at x. 

A conomsl to the polyhedron P at x is a vector t which makes 
an acute angle with every line segment in P at x, i.e., t (x-x) a 0 
for every x e P. By definition, t is a conormal to P at x if and 
only if tx a tx for every x e P; that is, the linear function tx 
attains its minimum at x. The set of all conormal vectors to P at 
X is called the conormal cone to P at x, and is denoted by T(x,P) . 
The symmetric reflection of T(x, P) across the origin is W{x, P) = 
-T(x, P) ; it is known as the normal cone. A vector in Nix, P) is 
a normal to P at x. With this definition, we can formulate ILP as 
minimizing k-variance from c, k{t-c) , over all conormals of P at 
X, that is, over the conormal cone r(x, P) . Thus ILP is: 

Minimize fit) = kit-c) {5.15a) 

such that 

t 6 T (x, P) . (5.15b) 

The optimal solution to ILP is called a minimal k-variance 
conormal to P at x from c. 

Feasibility Cone to P at 5E 

A feasible direction y to P at x is by definition a vector y 
€ X + ey € P for some 6 > 0 , i.e., 

X + ey = X for some x e P, © >0, 

or, y = X{x - x) , X & 0 and some x e P. 

0 vector is also considered a .feasible direction at any point x to 
P, Thus the set of all feasible direction to P at x is the cone 
K(P-x) generated by the convex set P - x. We call KiP~x) as the 



feasible cone to P at 5. Since P - x is a polyhedron containing 
the origin, JC(P-3f) is a polyhedral cone (see Rockafellar [1970, 
Corollary 19.7.1]). We state this result as the following lemma. 

Lemma S.X : The feasible cone K(P - 5j to P at ? Is a polyhedron. 


NOW we study the polarity relationship between the convex 
cones tS, P) and K(P - x) before considering the existence of 
minimal k- variance conormal to P at x from c. 

We define the copolar K* of a convex cone K as the set {yl yx 
a 0 for every X e K) . Recall that the polar K° of K, by 
definition, is the set {y I yx s 0 for every x e K} . For a 
non-empty convex cone K, K* - -K° = (-K)°. The following results 
are straightforward conversion of polarity results on polyhedral 
cones (see Schrijver [1986, Theorem 9.1]) to copolarity results. 


5.2 : Let K be a non-empty convex polyhedral cone. Then: 

(a) is a non-empty polyhedral cone. 

(b) K = K. 

(c) If K = coneix^s ...x then k" = {y ^ \ y Xj ^ 0 for j 

= 1, t, and converse also holds, i.e. , given K , K is the 

cone generated by {x^, x^}. 

The following theorem gives the copolarity between the 
conormal cone T(x, P) and the feasibility cone K{P-x) relative to 
a point X in the polyhedron P. 


Theorem 5.1 : Let x be a point in a polyhedron P. 

(a) The conormal cone T(x, P) and the feasibility cone K(P - 


are copolar to each other. 



(b) Both T(x, P) and K(P - x) are (non-empty ) polyhedral cones. 

(c) -K(P-x) is the polar of T(x, P). 

Proof : By definition, t e T(x, P) if t(x - x) & 0 for every x e 
P, i.e., ty £ 0 for every y e P - 3?. .Also, if ty £ 0 for some y, 
then t{Xy) ^ 0 for every X £ O. Hence t e T(jF, P) if and only if 
t(Xy) £ 0 for every y e P - 3? and for every X £ 0, i.e., ty £ 0 
for every y e K{P - x) . Hence T (x, P) = K* {P - x) . 

From Lemma 5.2(b), 

T* (x, P) = (K (P - 3f ) ) ** = K (P - . 

By Lemma 5.1, K(P - x) is a non-empty polyhedral cone. It 
follows from Lemma 5.2(a) that T(x, P) = [IC(P - x) ] * is also a 
non-empty polyhedral cone. 

(c) follows from the definitions of polar and copolar. ^ 

Now we turn our attention to the existence and finiteness of 
the optimum solutions to the inverse linear programming problem 
(ILP) . We mahe use of the following Lemma which is a partial 
statement of the results in Rockafellar [1970, Theorem 27.1(d) and 
27.3] . 

Lemma 5.3 : Let h be a closed proper convex function on P™ vhich 
attains its minimum on a non-empty bounded set, and let S be a 
non-empty closed convex set. Then h attains its infimum over S. 
Now we state and prove the following theorem. 

Theorem 5.2 : A minimal k-variance conormal to P at x from c (an 
optimal solution to ILP) exists and its value is finite, that is, 
the inverse linear programming problem has finite optimal 
solutions. 
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Proof : The objective function in ILP is fit) = kit - c) , where h 
is anunorm. Thus, by definition, fit) attains infimum, which is 
zero, at the unique point c. Furthermore, the set of feasible 
solutions Tix, P) is non-empty polyhedral cone by Theorem 5.1(b), 
and hence a non-empty closed convex set. 

By applying Lemma 5.3 with h(t) = f(t) = kit-c) and S = Tix, 
P) , we conclude that kit-c) attains its infimum over Tix, p) , 
i.e., optimal solution to ILP exists. The finiteness of the 
optimal solution follows from the fact that kit-c) is finite 
everywhere on JR™. ^ 

Duality in Inverse Linear Programming 

We study the duality in inverse linear programming. As 
defined in the previous section, let c e P™, x e P, p a polyhedron 
in R™ , and k be an unorm on P™. Let be the polar of k. 

The inverse linear programming problem (ILP) is the problem 
of finding a minimal P- variance conormal to P at x from c, which 
is formulated as below: 

Minimize kit - c) 

subject to 

t e r (x, P) , 

where r{x, P) is the conormal cone to P at x. 

Now we proceed formally to define the dual DILP of ILP. We call a 
feasible direction y to P at x as k° -normalized if k°iy) = 1. A 
direction y is called c-descent direction if cy < 0; its value is 
-cy. We define the dual DILP of ILP as the problem of either 
finding a maximal c-descent k°-normalized feasible direction y to 



p at X if one exist or concluding there is no c-descent 
(lc°-nortnalized) feasible direction. In the latter case the' null 
vector is the optitnuni solution and the optimum value is zero. We 
call the optimum value of the DILP as the maximum c-descent over 
all 7c°-normalized feasible directions to P at x (and the null 
vector) . 

Theorem 5.3 : DILP is : 

Max -cy (5.16a) 

subject to 

y e K(P-x)nR°, (5.16b) 

where R° = {y\k°(y) £ 1}, and k° is the polar of k. 

Proof : The feasible set K(P-x)nR° contains all feasible 
directions to P at x with j£°(y) s 1. Therefore, an optimum 
solution to (5.16) is a maximal c-descent feasible direction over 
all feasible directions with k° iy) ^ 1. 

Note that K(P-x)aR° contains zero direction (Theorem 5,1 (b) 
and Proposition 5.1) . Therefore, if there is no c-descent 
feasible direction to P at x, 0 is obviously an optimum solution. 

Suppose there is a c-descent feasible direction and y is an 
optimal solution to (5.1b) . The proof is complete if k (y) = 1, 

since there is c-descent direction, y 0 and k (y) > 0. Suppose 
Jc°(y) <1. Let y = y/J£°(y); the k°(y) = l. Therefore y e 
K(P-x)rvR°, since KiP-x) is a cone. Further -c(y) = l/k (y) (-cy) 

> - cy, contradicting y is an optimal solution. Therefore, k (y) 

= 1 . ■ 
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Theorem 5 . 4 


A maximal c-descent h° -normalized feasible 
direction to P at x (an optimal solution to DILP) exists and its 
value is finite. Moreover, there exists an extreme point of 
K(P-x)r\R^ vhich is a maximal c-descent -normal! zed feasible 
direction to P at x. 

Proof : K{P-x) is a polyhedron cone (Theorem 5.1(b)) and is a 
closed bounded convex set having the origin as its interior point 
(Proposition 5.1) . Therefore IC(P-x)rvR° is a closed bounded convex 
set containing the origin. The supremum of the linear function 
-cy over a nonempty closed bounded convex set is finite, and it is 

attained at some extreme point of the set (Rockafellar [1970, 

Corolla 3 ry 32.3.2]). Hence the theorem. ^ 

The following is the weak duality result in inverse linear 

programming . 

Theorem 5.5 (Weak Duality) : For any t e T(x, P) and y e 

K(P-x)nR°, (-c)y s k(t-c). 

Proof : Consider arbitrary t e T{x, P) and y e K(P-x)nR°, where 

R = {t|k(t) s 1 } and = {y|k°(y) s i}. Then k(t-c) = y(t-c|J?) = 

Inf {4 a 01 (t-c) e 4 R} . If k(t-c) = 0, since k is an unorm, (t-c) 

0. Therefore (t-c)y = 0 = k(t-c) . Suppose k{t~c) = 4 > 0 . 

Then (t-c) € 4 R, i.e., {t-c)/\x e K. Since y e and R and 

are (non-empty) closed convex sets polar to each other, 

(Preposition 5.1) ((t-c)/ 4 ).y s 1 . Therefore, (t-c) .y s 4 = 

% 

k{t-c). Thus, (t-c)y s Jt(t-c) . 

We have ty a 0 , since t e T(r, P) and y e K(P - x), and T(x, 
P) and K{P x) are (non-empty) closed convex cones copolar to each 
other (Lemma 5.1). Consequently, (-c)y s {t-c)y s h(t-c) . ■ 



We know that, by Theorem 5.2 and Theorem 5.4, both the 
inverse linear programming problem (JLP) and its dual {DILP) have 
finite optimal solutions. Further, from the above weak duality 
theorem, we have 

Max {(-c)yly e K(P - x)nR°} 

s Min{f‘(t) = k(t-c)|t e T{x, P)}. (5.17) 

Now we prove the duality result for inverse linear 
programming; that is, max = min in the relation (5.17). We first 
prove the following result. 

Lemma 5.3 : The conjucfate f (y) of the objective function f(t) = 

k(t-c) in the inverse linear programming problem (ILP) is given by 
f'^CY) = cy + h(y\P°) 

Proof : We have f * (y) = cy + k* (y) Rockafellar [1970, p. 140]. 

By Proposition 5.1, Jc (y) * 5 (y|P°) . ■ 

The dual (DILP) is equivalent to the problem: Maximize {-[cy 
+ 5{y|R°)]ly e KiP - x) } [Here we use the convention that the 
objective function value of an infeasible solution is -«> in a 
maximization problem]. By Lemma 5.3, this can again be rewritten 
as the following : 

Maximize {-f (y) ly e K(P - x)}, 
where f (t) = k(t-c) . 

Now we state and prove the duality theorem. 

Theorem 5.6 (Duality theorem for inverse linear programming). Let 
c 6 and X e P, vhere P is a polyhedron in R™ and let k be an 
unarm and k° be its polar. Then the values of minimal K-variance 
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conormal to P at x from c and maximal c-descent k -normalized 
feasible direction to P at x are equal; that is. 

Max {-cy\y e K(P - x)rR°} 

= Min {k(t-c)\t e T(x, P)}, (5.18) 

where Pp = {y\k°(y) - 1}- 

Proof : By the remarks preceding the theorem, we can rewrite 
(5.18) as follows : 

Max {-f* (y) ly € fC(P - x) } = Min {f (t) It e (x, P) } , (5.19) 

where f * (y) = cy + 5 (y|R°) and f(t) = k(t-c) , which has to be 
proved . 

We now make use of a result which is a direct corollary of 
Theorem 31.4, Rockafellar [1970], which is the following: 

Let h be a real -valued convex function and K a non-empty 
polyhedral cone in R*" and K* the copolar of K. Then 

Inf{h(t)lt e K} = sup {-h*(y)ly e K*}. (5.20) 

By Theorem 5.1, T* (x, P) = K(P - x) and T(x, P) is a 
non-empty polyhedral cone. Further, since 7£(t) is real-valued, so 
is f(t) = k(t-c) . Now, by letting K = T(x, P) and h(t) = f(t) in 

(5.20) we have 

Inf{f(t)|t € T(x, P) } = sup{-f*(y)ly e K(P - x) } (5.21) 

Since, by Theorem 5.1 and Theorem 5.4, both ILP and its dual 
DILP have finite optimal solutions, we can replace Inf and sup m 

(5.21) by min and max respectively. Thus we have proved (5.19)- ■ 



necessary and Sufficient. Conditions for Optimality in Inverse 
Linear Programming : 


The following result directly follows from the duality 
theorem and the weak duality theorem. 

Theorem 5.7 : Let t be a feasible solution to ILP and y a 

feasible solution to its dual DILP. Then t and y are optimal 
solutions to ILP and DILP respectively if and only if 

k(t - c) = -cy. (5.22) 


Proof : The necessity follows from the duality (Theorem 5.6). The 
sufficiency by the weak duality (Theorem 5.5) . ■ 


We derive Kuhn-Tucker conditions for ILP in Theorem 5.8. One 
can also derive these conditions from Theorem 31.4, Rockafellar 
[1970] . 


Theorem 5.8 ; Let t be a feasible solution to ILP and y a 
feasible solution to its dual DILP. Then, t and y are optimal 
solutions to ILP and DILP respectively if and only if the 
folloving conditions hold : 


(a) The linear function (t-c)y attains its maximum over R at y, 
that is. 


k(t-c) - S^((t-c)\R° ) - (t-c).y. 


{5.23a) 


(b) t and y are perpendicular to each other, that is, 
t.y = 0. 


(5.23b) 


Proof : We have, by Proposition 5.1, k{t-c) - 5 {t-c\R ). 

Therefore, since R° is a non-empty closed bounded convex set 

^ o 

k(i-c) = 5*(t-c|R"') = (t - c).y for some y e R . 
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Sufficiency : By (a), (t-c)y = 5 (t-c|R°) = k{t-c) . 

By (b) , (t-c)y = -cy. Therefore, k(t-c) = -cy. 
Hence, by Theorem 5.7, we have the sufficiency. 

Necessity : Since t and y are the optimal solutions to ILP and 
DILP, we have k{t-c) = -cy. Since T e r{x, P) and y e K:(p - 
we have t.y a 0, and consequently -cy s (t-c)y. From the remarks 

A A. 

at the beginning, we have k(t-c) = (t-c)y for some y e p°. Hence 

A 

(t-c)y = k(t-c) = -cy s (t-c)y. Since y e and kl,t-c) = 

5*{t-clR°) imply that (t-c)y £ (t-c)y = k(t-c) = 5*(t-clP°), which 
in turn implies (a) . Further, k(t-c) = -cy = (t-c)y implies t.y = 
0 which proves (b) . ^ 

The existence of finite optimal solutions to the ILP and DILP 
together with Theorem 8 give the following optimality conditions 
for ILP and DILP. 

Theorem 5.9 : A feasible solution t(y) of IP (DILP) is an optimal 
solution if and only if there exists a dual (primal) feasible 
solution y(t) satisfying the following conditions. 

(a) S^(t-c\R°) = (t-c).y 

(b) t.y = 0. 

Note that, when t is a minimal k- variance conormal to P at x from 

c and y is a maximal c-descent /c°- normal! zed feasible direction to 
P at X, we have 

h{t-c) = 5 (t-c|R°) = {t~c)y = -cy. (5.24) 

IIP on Systems of Linear Constraints in Standard Form 

We have treated so far the polyhedron P and the conormal cone 
Tix, P) and the feasibility cone K{P - x) as sets. Now we treat 



the polyhedron P as a system of linear constraints. We now obtain 
the representations for T{x, P) and K{P - x) as a system of linear 
constraints. These representations are important in solving the 
inverse linear programming problem. 


We choose the following 

form 

for 

a system of linear 

constraints, denoted by P : 




II 



(5.25) 

Ij ^ Xj S Uj for J = 1, 

2, . . . 

/ m 

(5.26) 

Here 4 is a nxm real matrix. 

Jb is 

nxl 

real vector, x is a 


arbitrary point in P*" , Uj's and -ij's are real numbers. We assume 
Uj as 00 when there is no upper bound, and Ij as -oo when there is 
no lower bound. The coordinates Xj of x are called variables. 
The vector b is called as the right-hand side vector, and Uj's as 
upper bounds and -ij's as lower bounds. The above representation 
is usually known as the standard form in linear programming. The 
other representations can be easily transformed to the above form. 


Let 5iF be a solution to P. As we shall see in the following 
discussion, the vector b does not play any role in the 
representation of T{x, P) and K(P - x) . The role of the upper 
bounds and lower bounds is limited to deciding the boundary status 
of the variables, that is, deciding whether the variable is at its 
lower /upper bound. 

We define index sets U, V and W for a given solution x in P 
as below : 

u = {j I Ij < Xj < Uj.}, 

V = {j 1 X. = 1.}, 

W = {j I Xj = Uj}. 


(5.27a) 

{5.27b) 

(5.27c) 
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The sets U, V and W denote the sets of variables whose value is in 
between the bovinds, at their upper bound, and at their lower bound 
respectively. 

The following lemma gives the representation for the 
feasibility cone K{P - x) . 

Lemma 5.4 : Let x be a solution to P. Let {U, W} be a 

partition of variables as defined by (5. 27). Then the feasibility 
cone K(P - X ) to P at X is given by the following system of linear 
constraints : 

dy = 0, (5.28) 

yj a 0 for all j 6 V, (5.29) 

y. s 0 for all j e W. (5.30) 

Proof : By definition, y is a feasible direction to P at x if 
x+6y, for sufficiently small 0 > 0, is a feasible solution to P. 
Substituting x+0y for x in P, we have d{ey) = 0 and Ij - Xj s ey 
s Uj - X. for all j = 1,2, ..., ffi. d{ey) = 0 if and only if dy = 
0, since 0 can be chosen arbitrarily small, the condition Ij - Xj 
s ey ^ Uj - X. for all j = 1,2, ..., m is equivalent to the 

conditions (5.29) and (5.30). On the other hand, if y satisfies 
(5.28), (5.29) and (5.30), we have d{ey) = 0 and 1. - x. £ 0y s Uj 
- X. for all j = 1,2, ..., m for sufficiently small 0 > 0. Hence 

y is a feasible direction of P at x. ■ 

Lenmta 5.5 : The conormal cone T(x, P) is the set of all t = (t^, 
■ * ‘ ' ^m^ satisfying the following linear constraints together with 
sows n, an Ixn vector, and a set {Uj, j e VuW> ; 




= 71 

d.j 

for 

all 

j 

€ 

u. 

(5.31) 


= 71 

d. j + 4 , 

for 

all 

j 

€ 

V, 

(5.32) 

t . 
J 

= 71 

d.j - Hj 

for 

all 

j 

€ 

W, 

(5.33) 

^j 

2: 0 


for 

all 

j 

€ 

VuW 

(5.34) 


where d. j denote the jth column of d. 

Proof : Recall that, by definition, a conortnal t to P at x is a 
vector t such that x is an optimal solution to the following 

linear program : 

Minimize t x (5.35a) 

dx = b {5.35b) 

Ij. :£ Xj £ Uj, j = 1,2, ..., m (5.35c) 

By the well-known complementary slackness conditions for bounded 

linear programming (see, for example, Murty [1976]), x is an 

optimal solution to the linear program (5.35) if and only if there 
exists a vector n e R satisfying the following conditions : 


t . = n d.j for all j e U (5.36) 

t. 2: TT d.j for all J e V (5.37) 

tj £ n d.j for all j e W (5.38) 

These conditions are the same as (5.31) - (5.34) , which proves the 

lemma . ■ 

When we use the representations of T(x, P) and K{P - x) 
developed in Lemma 5.4 and Lemma 5.5, the inverse linear 
programming problem (ILP) and its dual (DILP) become the following 
mathematical programs respectively. 
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Minimize k{t-c) 
sTobject to 

tj = TT d.j 
tj n d.j + IX. 
tj = n d.j - IX j 
IX. s 0 


Maximize -cy 


subject to 


dy = 0, 
y. 2: 0 
yj- ^ 0 


for all j 6 U, 
for all j € V, 
for all J e W, 
for all J e VuW, 


for all J e V, 
for all j e 


y e J? , 

Here k is an unorm and JR° is the set generating its polar 
is, = {yl?£°(y) s l}. 


(5.39) 

(5.40) 

(5.41) 

(5.42) 

(5.43) 

(5.44) 

(5.45) 

(5.46) 

(5.47) 

(5.48) 
, that 


Let t e T(x, P) and y e K(P-x) . Then, for some n and 
{n:jeVuW}, t satisfies (5.31) - (5.34) . Therefore, 


t.y = ndy + ~ E 

jeV 


rj Jew 


= E - E M,-y,* (since n dy = 0) , 

jeV J ^ jeV J J 

Since 4 - a 0 and y. ^ 0 for j e V and y . s 0 for j e W, t.y = E 


j€V 


- E M.-y.- imply that t.y = 0 if and only if 
J ^ Jew ^ 


l^jYj = 0 foi: all j e V u W. 


The following result is immediate from the above discussion and 
Theorem 5.8. 



The inverse network flow problem {IF), given a unorm k{x) on 
R®, is to find a conormal t to F at x such that k(t-c) s k{t-c) 
for any conormal t (that is, with minimum k-variance from c) . it 
is fomiulated as the following problem : 

Minimize k(t-c) (5.53) 

subject to 

t 6 r(x, F) . (5.54) 

The optimal solution t to IF is called a minimal k~variance 
conormal to F at x from c. 

Let k° be the polar of the unorm k. Let y be a feasible flow 
direction to F at x, that is, x + ©y is a feasible flow satisfying 
the flow conservation equations (5.51) and the flow constraints 
(5.52) for small values of ©. A feasible flow direction y is 
k°-normalized if k°(y) = 1. The dual DIF of IF is defined as the 
problem of finding a maximal c-descent k°-normalized feasible 

direction to F at x or verifying there is no c-descent flow 
feasible direction to F at x. The formulation of DIF is as 
follows : 

Maximize -cy (5.55) 

subject to 

y e K(F - x) , (5.56) 

y 6 i?°. (5.57) 

Here k(F-x) is the feasibility cone to F at x and R°={y|k°(y)s l}- 

The matrix representation of F is : 

NX = Jb, (5.58) 

0 £ X s u. (5.59) 


Here b is the supply/demand vector and it is the capacity vector. 



The matrix N is called the node-arc incidence matrix of the 
graph G = (N, A) . The columns of // are indexed by the arc set A 
and its rows by the node set N, The column corresponding to an 
arc (i/ j) has 1 in row i and -l in row j and zeros for rest of 
the entries. Let denote the column corresponding to the arc 

(i, j) . Then, 

n N^. = Tr(i) - Tr(j) (5.60) 

Let X be a given flow and U, V, W denote the arc sets as 
defined below : 

U = { (i, j) € .a I 0 < x^. < u^j}, (5.61) 

V = { (i, j) e .a 1 0 = x^j}, (5.62) 

W = {(i, j) € A \ x^. = (5.63) 

The following polyhedral description of T{x, F) and K(F - x) 

are immediate from Lemma 5.4 and Lemma 5.5. 


The conormal cone T{x, F) by Lemma 5.5 is the set of all 
vectors t = (t. .) satisfying the following constraints : 


t^. = n{i) - Tcij) 
t^j = 7i(i) - n(j) + 
t^j = 7r(i) - n{j) - u^j 


for 

all 

(i/ j 

) € U, 

(5.64) 

for 

all 

(i/ j 

') e V, 

(5.65) 

for 

all 

(i/ j 

') € W, 

(5.66) 

for 

all 

(i. j 

f) e VuW. 

(5.67) 


Here 7 r(i) is a node potential associated with node i. Note that, 
by (5.60) the product of tt with a column of N corresponding to (i, 
j) is 7 r(i) - nij) . Of course, the constraints (5.64) - (5.67) are 
the optimality conditions for flow x to be a minimum cost flow 
with respect to the cost t . 
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The feasibility cone K(F - a), by Lemma 5.4, is the cone 
given below : 

V i 0 for all (i, j) « V, (5.69) 

Y <0 for all (i/ j) ^ (5.70) 

Thus a feasible direction to F at x is a circulation satisfying 
(5 . 68) - (5 . 70) . We will call K(F - x) also as the feasible 

circulation cone to F at r. 

Now we can restate the formulation of IF and DIF as follows. 
The formulation of IF is : 

Minimize k{t-c) (5.71a) 

s^abject to 


= Tr(i) 

t^j = 7T(i) 

t^j = n(i) 
“ij ' ° 


- n(j) 

- 71 (j) + 

- 7r(j) - n^j 







(5. 

71a) 

for 

all 

(i, 

j) e 

U, 

(5. 

,71b) 

for 

all 

(i, 

J) 6 

V, 

(5, 

.71c) 

for 

all 

(i, 

j) e 

w. 

(5 

.71d) 

for 

all 

(i, 

j) e 

A. 

(5 

.71e) 


The formulation of Z7IF is 
Maximize -cy 
subject to 

J^y = 0 , 

y. . a 0 


yij ‘ ° 
7 e tt°. 


for all (i, j) e V, 
for all (i, j) 6 W, 


(5.72a) 

(5.72b) 

(5.72c) 

(5.72d) 

(5.72e) 


where = {y 1 (y) ^ l} 


The inverse flow problem is a special case of the inverse 
linear programming problem. The results obtained in Theorem 5.2, 



Theorem 5.4, Theorem 5.6 and Theorem 5.10 are summarized below 
for the inverse flow problem. 

Theorem 5.11. Let c e r”*, and x € F. Let IF and DIF be the 
programs as defined by (5.71) and (5.72) respectively. Then, 

(a) Both IF and DIF have finite optimal solutions. 

(b) The optimal values of if and DIF are equal. 

(c) Let t and y be the feasible solutions to IF and DIF 
respectively. Then they are optimal solutions to the 
respective problems if and only if they satisfy the following 
conditions : 

(i) the linear function (t-c)y attains its maximum over R° 
at y, that is, 

k(t-c) = S^(t-c\R°) = (t-c)y. (5.73a) 

(ii) 4 . . y. . * 0 for all arcs (i, j) e VuW. (5.73b) 


5.4.1 Euclidean Variance 


An Euclidean inverse linear programing problem (EILP) finds a 
conormal t with minimum llt-cll, where 


\x\ 


I x.^. , xr € R*" 

4 [i,j)eA ^ 


(5.74) 


The conormals we consider here are conormal to a polyhedron P at 
X. Let 

B = {x I Ihdl £ 1} . (5.75) 

The polar of 1 1 1 1 is itself, and 

lltll = y(tlB) » 5*{tlB) (5.76) 

Hence EILP is : 

Min {llt-dl t e T(Xj P)} (5.78) 
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(5.79) 


Its dual DEILP is 

Max {-cy I y e kiP-x)nB} 

EILP has a unique optimum solution t, since the strictly 
convex function llt-dl has unique minimum over closed convex set 
(polyhedral cone) T{x, P) . Let y be any optimal solution to the 
dual DEILP. Then, by Theorem 5.8, we have 
(i) I It-cl I = 5* (t-clB) 

= Max{{t^-c)y 1 y e B} = {t-c)y , that is, (t-c) is 
normal to B at y. 

(ii) t.y = 0 

By the duality in ILP (Theorem 5.6), we have 
1 1 t-c 1 1 = -cy = 4 (say) 

When the problem is trivial, we have t = c, y = 0, when it is not 
trivial y ^ 0 and II y II = 1 (see the proof of Theorem 5.3) . In 
this case, any normal to B at y is a positive scalar multiple of 
y, that is, 

(t-c) = \ y, A > 0. 

Therefore, by (i) , we have 

II t-c II = (t-c)y = xyy = AllylP = A. 

Hence A = ji. Thus we have proved the following result. 

Theorem 5.12 : EILP and its dual have unique optimal solutions, 
say, t and y respectively. Then 

(a) t = c + iL y, n = llt-dl * -cy 

(b) t.y = 0 




(5.80a) 

(5.80b) 



Now consider the following minimization problems : 
Minimize {l/2 llt-dl : t e T(x, P)} 

r\ 

Minimize {l/2 lly-cll : y € -K(P-x)} 


(5.81) 


(5.82) 


The problems (5.81) and EILP (5.78) are equivalent problems 
having the same unique optimal solution t. The problem (5.82) 
also has an unique optimal solution. Let y denote the optimal 
solution to (5.82). By Moreau decomposition theorem (see Theorem 


31.5, Rockafellar [1970]), we have 
c = t + y 
and t.y = 0 

Comparing (5.80) and (5.83), 

\ y = - y 

where X = II t-c II = -c.y. 

Talcing norm on both sides of (5.84 
X = II y II 

y 

Here y = " / 

II y II 

and 1 1 y 1 1 « 1 1 t-c 1 1 = -cy. 


{5.83a) 

(5.83b) 

(5.84) 

, we have 

(5.85) 

(5.86) 


Let P == F, where F is the system of flow constrains given by 
(5.51) and (5.52). Then by the representation of K{F-x) given by 
(5.61) - (5.63) , the problem 

Minimize {l/2 II y-c iP • Y ^ -K(F-x) (5.87) 
becomes the following quadratic cost flow problem (QCF) 
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Minimize 1/2 


( 5 . 88a) 


{i,j)eA ■’ 


Hy = 0, 
^ij " ° 


for all (i/ j) € V, 


y. , >: 0 for all (i, j) e 


(5.88b) 

(5.88c) 

(5.88d) 


We now conclude the following result from above discussion. 

Theorem 5.13 : Let y be the optimal solution to QCF defined by 
(5.88). Let t and y be the optimal solution to the Euclidean 
inverse flow problem (EIF) and its dual (DEIF) . Then, 

(a) II t-c II = - cy = II y 11^ (5.89) 

(b) y = -y/llylL (5. so) 

(c) t = c - Y, (5.91) 

5.4.2 Weighted Rectilinear Variance 

In this section, we will take the objective function as 
weighted rectilinear variance in the inverse problem. 

A weighted rectilinear variance of a vector t from c is 

. bjj(tjj-Cjj)' ) (5.92) 

where a. . and b. . are positive real numbers ; for a real number t, 
■ij ij 

t"*" = max{0, t) and t~ = max{0, -t}. 

The fxinction 


K (t) : = I 


(a..t-. +b. .t..) 


^ (i7j)sA 

is a unorm and it is generated by the set 

= { t € I^\l + b^j t^j ) S 1 } 


(5.93) 


(5.94) 



That is, 


k^{t) = y(t|jR^) 


The polar of is the set 

K„ = {y ^ = y^J » 

and jR^ generates the following unorm : 

KJt) : = max I ^ ^ I (i, J) e ^ I 


Thus, 


k (t) = y(t|R ) 
00 00 


(5.95) 


( 5 . 96 ) 


(5.97) 


(5.98) 


The unorms k and k are polar to each other. 

00 

The following lemma is a direct application of the 
Proposition 5.1. 

Lemma 5.6 : (a) - 5 (t|R^) and its conjugate is 6(tiR^). 

(b) k^{t) = 5 (t|R^) and its conjugate is 5(tlR^). 

Now we state the weighted rectilinear inverse flow problem, 
(WRIF) ; 

Minimize k^{t-cj (5.99) 

subject to 


n(i) 

- Tr(j) 


for (i, j) 

€ U, 

(5.100a) 

n(i) 

- 7r(j) 

* <^ii = ‘ij 

for (i, 

j) e V, 

(5.100b) 

nil) 

- 7t(j) 

■ “ij ' ‘ij 

for (i. 

j) € V. 

(5.100c) 


0 




(S.lOOd) 


An optimal solution t to WRIF will be called a minimal weighted 
rectilinear conormal variance to F a r from c. 
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The dual DWRIF of WRIF is 

to find 

a maximal 

c-descent 

normalized feasible direction to F 

at X with 

respect to 

unorm k . 

00 

Thus DWRIF is the following problem 

: 



Maximize -cy 



(5.101) 

sub j ect to 




O 

11 



(5.102a) 

y. . > 0 for (i, j) 

€ V, 


(5.102b) 

y, , < 0 for (i, j) 

6 W. 


(5.102c) 

y € JR . 



(5.102d) 

The description of given in (5. 

96) imply 

that the constraints 

{5.100b), (5.100c) and (S.lOOd) 

in DWRIF 

can be replaced by 

(5.102c), (5.102d) and (5.102e) in the following formulation of 

DWRIF. 




Maximize -cy 



(5.103) 

subject to 




O 

li 



(5.104a) 

*ij " yij ‘ “a 

for (i, jl 

1 € 17, 

{5.104b) 

0 = 

for (i, j] 

1 6 7, 

(5.104c) 

-b. . s y. . £ 0 

ij 

for (i, j. 

) 6 W. 

(5.104d) 

We can interpret 

profit . 

Note that 

maximizing 

the profit -cy is equivalent to minimizing the cost cy. 

Thus, the 

representation of WRIF given by (5 

,103) - (5.104) is a minimum cost 


(maximum profit) circulation on the given network G = (N, A) with 
(finite) bounds given by (5.104b) - (5.104c) . 

Let y be an optimal solution to WRIF ( 5 . 103 ) - (5 . 104) , that 
is, a maximal c-descent feasible direction to F at x. Then by the 
con^lementary slackness for linear programming, there exists an 



optimal node potential ti satisfying the following conditions: 


Tt(i) - 7T(J) 

= 

^ij 

if *ij < yij < “ij . 

(5.105a) 

if Tr(i) - 7i(j) 

< 

’^ij 

then 5 . . = y. . , 

(5.105b) 

if 7r(i) - nij) 

> 


then y^j. = , 

(5.105c) 

where is if 

(i 

. J) 

€ Uuiy, 0 otherwise. 

and u . . is a . . if 


(i, j) e UvV, 0 otherwise. 

Let 7T be such a potential, and let 


Define 



= Ttii) - nij) 


for (i, j 

) € U 

(5.106a) 


= max {Tr(i) - 


for (i, j 

) e V 

(5.106b) 

‘ij 

■= min {7T(i) - 

Tr(j)/ c^j-} 

for (i, j 

i) e W 

(5.106c) 

“ij 

U 

1 

11 

for (i, j) 

e VvW 


(5.107) 


Then t, together with n and defined by (5.107) satisfy 

(5.100) . Hence t is a conormal to F at x. 


Suppose >0. If (i, j) e V, then n(i) - n{J) < c^j by 

(5.106) and hence by (5.105) y^j = = 0. If (i, j) € W, then 

Tc(i) - nij) > c.j by (5.106), and hence by (5.106) ^ ^ °- 

Therefore, we have 


U. . y. . » 0 for all arcs (i, j) e Vvtt 


(5.108) 


Now consider an arc (i, j) and let t^j > Then arc (i, 

j) is in either U or V; in both cases, definition 

of t . ., t.. = Tr(i) - nij). Therefore 7r(i) - n(j) = t^. > 






implies (by (5.106c)). Hence y^j - 


ij 

Therefore , we 


have, if t 


^ C • • t 



By similar arguments, if then arc (i, j) is either in V 


or 


V, and y . . = -b. .. Therefore, if t . . > c. . 
1 J 1 J J 

a., (t. . - c. + jb. . (t . . - c. .)■ 


ij ij iJ 


ij ij 


3.J 


- ^ij 

= a.j - c.y 

= Yj^j (t.j - c..) 


Therefore , we have 


a.j {t.j - + b.j (t.j - c.j) = y.j (t.j - c.j) 

for all (i, j) e A, 


(5.109) 


since (5.109) holds obviously for the case Summing 

right and left hand sides of (5.109) over all arcs, we have 


k (t - c) = I y (t . . - c. .) = (t - c)y 


(5.110) 


Since t^^'s satisfy (5.100), 


t-y - Z tj[j yj^j - n U y + Y, ^ii ^ii ~ 

(i,j)€y 


(i , j)eW 




Since N.y = 0, and u^j y^. = o for (i, j) e V^M by (5.106), we 
have t.y = 0. therefore, by (5.110) (t-c) = -cy. Hence, by 

Theorem 5.7, t is an optimal solution to WRIF, that is, a minimal 
conormal to F at y from c. From the above discussion, 
we conclude the following theorem. 



Theorem 5.14 : The dual of WRIF (DWRIF) can be formulated as the 
minimum cost (maximum profit) circulation problem given by 
( 5 . 103)-(5. 104 ). Let n be an optimum node potential corresponding 
to a minimum cost circulation y to '(5. 103 )-(5. 104). Then t given 
by (^’ 106 ) is minimal Rj^^variance to F at x from c. Further, 
K^(t-c) = -cy . 

Recall that WRIF is trivial when t = c; this is the case if 
and only if x is a minimal cost flow to F (defined by 

( 5 . 51) - (5 . 52 ) ) . In this case, y = 0 is an optimal solution to 
DWRIF. 

VJhen X is not a minimum cost flow to (5 .,51) - (5 . 52) , then 

k (y) =1 by Theorem 5.3. That is, y is a circulation on G = (N, 
00 

A) with y. . “ a. , or -b. . for at least one arc. Further, when 

1 J 1 J IJ 

a^j's and b^j's are integers, the minimum cost circulation problem 
defined by (5 . 103) - (5 . 104) always has integral basic optimum 
solution (see Property 2.1); when are integers, the minimum 

cost circulation problem has an integral optimal node potentials 
corresponding to any basic optimum solution (see. Property 2.2) . 
Theorem 5.14 together with (5.106) imply that WRIF defined by 
(5.99) - (5 . 100) has integral optimum solutions. We summarize the 
above discussion in the following theorem. 

Theorem 5.15 : Suppose x is not a minimum cost flow to (5.51)- 

(5.52) . Then : 

(a) any maximal c-descent feasible direction normalized by k^(t-c) 
has the property that for at least one arc (i, j), ^ij ~ ^ij 
This is a minimum cost circulation to ( 5 . l03)-(5. 104). 


> 
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(b) When a./s and b./s in k^(t-c) are integers, ve have at least 
one integral maximal c-descent normalized feasible direction vith 
respect to k (t-c) which is a basic integral minimum cost 
circulation to ( 5 . 103 )-(5. 104). 

(c) When c^.'s are integers, we have at least one integral minimum 
jc —variance conormal from c. 


A Special Case ; Rectilinear Variance 

The rectilinear variance of a vector t from c is 


(i,j)eA 


(5.111) 


Note that llt-dl^ is a special case of k^(t-c) with - b^j = l. 

Suppose the given x is not a minimum cost flow. Then, by 
Theorem 5,15, we have maximal C“descent normalized feasibls 
direction with respect to II 11^ which is a basic integral minimuin 
cost circulation to the following problem : 


Maximize -cy 

(Minimize 

cy) 




to 






II 

0 






-1 = ^ 1 

for 

all 

(i, 

j) 6 

u, 

0 > y^ , = 1 

for 

all 

(i/ 

j) e 

V, 

0 

VI 

Yl 

H 

1 

for 

all 

(i/ 

j) e 

W. 


(5.112) 


Any integral circulation to (5.112) can be decomposed to at 
most m integral flows on at most m cycles in G by the flow 
decomposition theorem (see, the discussion in Section 4.2) . Since 
the flow bounds in (5,112) are only between -1 and 1, any integral 



circulation has = -1, 0, or 1 for each arc (i, j) e A. 
Consequently, integral cyclic flow in the above decomposition are 
unit flows and the corresponding cycles are disjoint. These are 
augmenting cycles with respect to the flow x and the cost of any 
integral circulation to (5.112) is the sum of costs of these 
disjoint cycles. Thus an optimum integral circulation to (5.112) 
is a minimum cost disjoint augmenting cycles (that is, a unit 
circulation on these cycles) with respect to the flow. Thus we 
have proved the following theorem. 

Theorem 5.16 : (a) A minimum cost disjoint augmenting cycles with 
respect to the flow x is a maximal c-descent normalized feasible 
direction with respect to 1 1 1 1^. 

(b) The minimum k-variance from c over all conormals at x with 
respect to 1 1 1 1^ is negative of the cost of a minimum cost disjoint 
augmenting cycles with respect to x. 


5.4.3 Weighted Maximum Variance 


A weighted maximum variance of a vector t from c is defined 


by 


k (t-c) = 
00 


= Max ■{ 
(i,j)eA ^ 


(t^j-C^j) (t..-c. .) 




^^ij~^ij^ ’I 

' b. . J 

ij ^ 


(5.113) 


By Lemma 5.6, 


k {t) =5 (tlR.) 

00 X 


(5.114) 


where is given by 




(5.117) 



The set is the polar of generating unorm kjt), and 

generates unorm k^it) . 

The weighted maximum inverse flow problem (WMIF) is to find a 
minimal weighted maximum variance conormal to F at x from c. its 
(DWMIF) is to find a maximal c-descent normalized feasible 
^ij^ection to F at x with respect to unorm (t) . Thus the 
fQlIowing formulations of WMIF and DWMIF follows directly from 
(5.71) and (5.72). 


The weighted maximum inverse network flow problem WMIF is : 


Minimize max 

(i,j)eA 


(t . j-Cij) - , 

1 

(5.116a) 

i «ij 

' b. . 

ij 

1 

subject to 





7r(i) - n{j) 

= t . . 

13 

for all (1, j 

) e U, 

(5.116b) 

n(i} - n(j) 


for all (i, j 

) 6 V, 

(5.166c) 

n(i) - nij) 

•H 

At 

for all (i, j 

) € W. 

(5.116d) 

The dual DWMIF of 

the weighted 

maximum inverse network flow 


problem is : 


Maximize - c. . y. . 

(i,j) 6il 


subject to 


Ny = 0, 

Ylj 0 

rij* 0 


for a, j) € V, 
for (i, j) e W, 




(5.117a) 

(5.117b) 

(5.117c) 

(5.117d) 

(5.117e) 


The dual can be transformed to a linear programming problem 

A, ^ 

with nonnegative variables on a modified network G = (N, A) • 
each arc (i, J) in U\jV (the set of arcs on which flow can be 



increased), introduce an arc (i, j) in A with cost and weight 

^ij' each arc (i, j) in V\M (the set of arcs on which flow can 

be decreased), introduce an arc (j, i) with cost weight 

Let us denote the cost and the weights, as defined above, of 
arcs in A by and respectively. The dual problem can be 

A. A 

rewritten equivalently with respect to the network G = (W, A) as 

follows : 


- Minimize Y. ^ c . . z . . (Maximize - Y ^ c. . z. .) 
U,j)€A (i,j)€A 

subject to 


Mz = 0, 


^ 0 


for all (i, j) 6 A, 


(5.118a) 


(5.118b) 

(5.118c) 


E j z . . s 1 . 


(5.118d) 


Here A' is the node arc incidence matrix of the graph G. 


The dual DWMIF is equivalent to solving the minimum cost -to- 

A 

weight ratio cycle F in G, where cost-to-weight ratio of a 
directed cycle F in G is defined by 


/li(F) = 


E . 

_ (i,j)6F 


(5.119] 


^ ^ii 
(i,j)6F ^ 


Note that a^j > 0 and b^. > 0 for each arc (i, j) ^ A. 


By definition of 


A ^ 

w. ., the weight Y ® every 

(i,i)€F 


directed cycle F in G. 


Let F* denote any minimum cost-to-weight ratio cycle in G. 


Then we have 



(5.120) 


and 


M(r*) 

ju(r ) 


- c(r*) 
w{r*} 

< ^11^1 for any directed cycle F in G. 


(5.121) 


Let 

4 = - 4 (r*) . (5.122) 

A 

Then, for any directed cycle F in G, by (5.121), we have CiF) + n 

A A 

lii^(r) ^ 0, that is, J] i ^ Since there is no 

negative directed cycled in G with respect to costs ^ 

there exist node potentials it satisfying the following conditions: 


n{i) - 7 r(j) ^ c^. + M for all (i, j) € G (5.123) 

A A 

Suppose iT(i) - n(j) < + m for at least one arc (i, j) in 

r*. Then, summing the right hand sides and the left hand sides of 
(5.123) over all arcs in F*, we have 0 < C(F ) + n v (F ) which 
contradicts (5.120) together with (5.122). Hence 


7r(i) - nij) = c^j + 4 for all (i, j) e F . (5.124) 


Let t. . - 7i(i) - Tr(j) for each arc (i, j) e A. 

A A 


Since c^. = c^j 


and V. . = a., if (i, f) e A. and c. . = -c. . and i/- . = Jb . . if ij, 

ij ij ij ij ij ij 

i) € A, (5.123) implies that 


-M s . b.a^j 


for each arc (i, j) € A. Since a . . > 0 and b. . > 0, this implies 

J ^ J 


max 

(i, j)eA 


j I 

i ‘■ij J 


Further, for any arc (i, j) e F , if (i, j) e A, by (5.124), then 



^ ^ — = 4; else we have (j, i) e A and ■4 - — ^ 

^1] 


Hence , 


(t-c) = 

( 


= max •{ 

:i, 








= P. 


Further,- t together with n obviously satisfies (5.116) . 


Let z be the circulation on G defined by 




f i/w(r ) 

0 


if (i, j) e r 

otherwise 


then z is feasible circulation to (5.118), since 


(i,J}eA (i,j)er 


* '"ij 


y(r*) 

w[r*) 


1. 


Further, 

A 

-c.z 


I 

(i, j)6r 


* 



c(r*) 

(r*) 


h 


since t is a feasible solution to WMIF and z is a feasible 
solution to (5.118), which is equivalent to DWMIF, and 


A 

k(t-c) = -c.z = M, 


by Theorem 5.7, t is an optimal solution to WMIF and /i is the 
optimal value of WMIF (and DWMIF) . 

When X is a minimum cost flow, t = c and z = 0 are optimal 
solutions to WMIF and (5.118) respectively. Thus, in this case, 
zero is the optimal value for both WMIF and its dual . 

-fc * 

When X is not an optimal flow, 4 (r ) < 0; = -jj{r ) > 0. 

Hence the optimal value of WMIF and its dual DWMIF is 

max{0, -n (r ) } . 



Let r denote a augmenting cycle with respect to the flow x in 
5, and let f and r denote the sets of forward and backward arcs in 


F respectively. The cost C(F) 

and weight Br(F)of the 

cycle F are 

defined by 



C(F) = E _ c. . - 

(i,j)€r 

I ^ij 
(ifj)C 

(5.125) 

W(F) = E a.. - 

(i,j)€F 

I f 

(i,j)er 

(5.126) 

4(F) = C(F)/tf(F) 


(5.127) 

Note that F corresponds to 

the directed cycle F^ 

A 

in G which 


cons'' sts of arcs in F and the re'versal of the arcs in F and the 
cost-to- weight ratio of the cycle F, 4 (F) = is same as the 

cycle 4 (F^) as defined by (5.119). (Note that the construction of 

A 

G is same as G(x) except that arcs in G have weights and no 
residual capacities) . A cyclic flow on F is a cyclic flow F . This 
observation with our discussion implies the following theorem. 

Theorem 5.17 : (a) The optimal value of WMIF and its dual DWMIF is 
max{0, -u(r*)}, where F^ is a minimum cost-to-weight ratio 
augmenting cycle with respect to the flow x on G, and the cost-to- 
weight ratio u(r) of any augmenting cycle F is defined by (5.127). 

(b) Let TT be any node potential satisfying (5.123) and (5.122). 
Then (^£j = Tt(i) ~ T^(j) ’ (i> j) s A) is a minimum weighted 
maximum variance conormal to F at x from c. 

(c) The cyclic flow of value l/yi(T^ ), where W(T^ ) is a maximal 
c-descent feasible direction to F at x with respect to the unarm 

(the polar of k^). 



Special Case : Haxintum Variance 

The maximum variance of t from c is 
I It -cl I = max It . . - c. -I}. 

Thus llt-cll is a special case of k {t-c) with a. . = jb. . = l. 

“» 09 ij ij 

In this case, the weight W (D of an augmenting cycle P 
becomes the number of arcs in F denoted by IFl . The 

cost-to-weight ratio ji(r) of F becomes the mean cost of cycle F 

defined by 

T. j ~ H j 

(i,J)er 

4_(F) = (5.128) 

IFl 

The following result is the direct corollary of Theorem 5.17. 

Theorem 5.18 : The optimal value of MIF and its dual DMIF is 
max{0, “^^(F )}, where F is the minimum mean cost augmenting 
cycle with respect to the flow x. 

5.5 Inverse Spanning Tree Problem 

Consider a undirected graph G = (W, A) . Let be a spanning 
tree in G. Let c be a given cost vector, and k be an unorm. The 
inverse spanning tree problem (1ST) is to find a cost vector t 
such that k{t-c) is minimum and T® is a minimum spanning tree with 
respect to cost t . 

The co-normal cone for T° 

The co-normal cone of T° is the set of all vectors t such 
that T° is a minimum spanning tree with respect to the cost t . 
Thus the co-normal cone of is the feasibility region of the 
inverse spanning tree problem. 



We derive the representation for the co-normal cone of 
from the following optimality conditions (For example, see Ahuja 
et al. (1993), Theorem 13.1.). 

Cut Optimality Conditions : Let denote uhe cut obtained 

by removing a tree arc {h, 1) e T . The spanning tree T is a 
minimum spanning tree with respect to cost vector t if and only if 
it satisfies the following optimality conditions : 

t^j for every (i, j) e [S^, S^] and (5.129) 

for every (k, 1) e 


We now present the optimality conditions in (5.129) as networlc 
dual constraints. Let us index the non-tree arcs by = (i^, 

Jl>' 92 = -'2* 9n,-n+i = <Wl' Vn+1> 

’'l ° <-*11-11+2' ■'iii-n+2’' ’'2 “ <-*iii-n+ 3 ' Jm-n+3’ ’'n -1 “ <■*"' 


m' 


j ). We define the cut-graph G(T°) = (W(T°), A(T°)) as follows. 
•'m 

We define the node-set N(T^) = (T^) 0^2 (T^) / where = {q^, 

Qjjj-n+i) represents the non-tree arcs, and ^2 (T^) * 

..., represents the tree-arcs. We introduce arcs in G(T^) 

as follows. Let [k, 1) e T° and (ft, 1) = r^., we denote the cut 

[Si,, S,] by [S„ , S_ ] . Now, for each arc, r . » (ft, 1) e and 
K. 1 r J r J J 

for each tree arc g. = (p, g) e [S , S ] , we introduce an arc 

J '^3 

Vj) in G(T°) . The graph G(T°) constructed as above is a 
bipartite graph. 

To simplify the notations, we let N^{T^) = {g^, g 2 » •••' 

‘^m-n+l^ “ *•" m-n+1}, and N^{T^) * {r^, r^, ..., r^_^} = 

{ 1 , 2, ..., n-l}. We denote the arc (g^, r^.) in G(T^) by (i, j) ■ 



From the construction of G(T^) , we have the following result, 
which is an alternate statement of cut -optimality conditions. 

Theorem 5.19 ; The spanning tree is a minimum spanning tree 
vith respect to a cost vector t if and only if it satisfies the 
following optimality conditions : 

- Vj ^ 0 for every arc (i, j) e G(T°). (5.130) 


Here t ‘ ' ~ ^m-n+1' ■' ^n-1^’ 

Proof ; By construction, each arc {k, 1) e T, has a node in 

^2 (T^) and each arc (i, j) 6 S^] has a node i in N^{T°) . 

Conversely, each arc (i, j) e G{T ) represents a relation (i, J) e 
[Sj^, Sj] for some arc (k, 1) e r°. Thus, the condition 

.-V . 

i J 


(i, j) e (S^, Sj) is equivalent to u.-v. s 0 for (i, J) e G(t'*) . 


Corollary 5.18.1 : The co-normal cone T(T^) of T^ is the set, 

T(T^) = (t: - Vj s: 0 or exactly (i, j) e G(T^)), 

where t = (u^^, u^, ^n-1^’ 

In matrix form, 

T(T°) - (t: t a 0} . 

T° 

where ^ _ is the node-arc incidence matrix of G{T°) . 

T° 

Thus the inverse spanning tree problem (1ST) is : 

Minimize k(t-c) (5.131a) 

subject to 


t e T(T°) , 


(5.131b) 


where k{t) is a unorm. 

The dual DIST of 1ST is: 

Maximize -cy 
subject to 


y e [T(T°)]*, 
y 6 R°, 


(5.132a) 

(5.132b) 

(5.132c) 



where R° is the set generating the polar k of k and [T (7°) ] ig 

0 

the copolar of T (T ) . 

Theorem 5.19 : The copolar [T (T° )f is the set 

[T(T°)f = { yly = N X, X ^ 0 }. 

T 

Proof ; r(r^) = {t: a. t a O}, where a. are column vectors of jV , 

J J 

and j is the index set of column of N . By Lemma 5.2, its copolar 

is the cone {a. I jeJ} = {yl y = x, x ^ O). ^ 

J 

Now we use the representation of T(r°) and its polar 

0 * . . 

[T (T Tl ] , in the formulation of the inverse spanning tree problem 

and its dual. 

The inverse spanning tree problem (1ST) has the following 
formulation; 


Minimize k{t-c) 


subject to 


t a 0 
r° 


The dual DIST of 1ST is: 

Maximize -cy 
subject to 
N .X = y, 

yO 

x & 0, 

y 6 j?°. 


(5.133a) 


(5.133b) 


(5.134a) 


(5.134b) 

(5.134c) 

(5.134d) 


The following duality results follow directly from Theorem 5.6 and 


Theorem 5.7. 



Theorfem 5.20 : (Duality results in Inverse Spanning Tree Problem). 

Let r® be a spanning tree and c be a given cost vector. The 
optimal values of (1ST) and (LIST) are equals that is, 
min{ k(t-c): ^ t ^ 0 } 

= max{ -cy: N x = y, x ^ 0, y e } (5.135) 

Let t and y be the feasible solutions to 1ST and BIST 
respectively. Then they are optimal to the respective problems if 
and only if 

k(t-c) = -cy. (5.136) 

5.5.1 Weighted Rectilinear Variance 


Here we take the weighted rectilinear variance defined by 


k^ (t-c) : 


= Y. [a..(t..-c..)'*’+Jb..(t..-c..)~l 
(i.j)eA ^ f 


(5.137) 


as the objective function in (1ST) . We call the corresponding 1ST 
as the weighted rectilinear inverse spanning tree problem (WRIST) . 
We have, 

Kit) = I (a. .t . + b. .t . ■) (5.138) 

ii,j)eA 

and its polar, 

f y, / y,- r ^ 

(5.139) 


k (y) - max •[ , iii- ]• 

" ‘=ij I 


is generated by the set 

^o = - yij ^ 

Consequently, the dual DWRIST of WRIST is 
Maximize -cy (- Minimize cy) 


(5.140) 


(5.141a) 


s\xbject to 



(5.141b) 


y = N ^ X, 


-b. . s y £ a . . for every (i, J) e A, 

Xij ^ 0 . 


(5.141c) 

(5.141d) 


The equations (5.141b) can be expanded as follows : 


(p,q]^eA(T^) ^ 


= Yj^j for every p « (i, j) € N^(T^) . 


(5.142a) 


j; = y. . for every g « (Jt, I) e W, (T ) . (5.142b) 

(p,g)eA(T°) 


Note that N^{T°) = T°, (T°) = A - T° and p » {i, j) means p is 

the node in G(T^) corresponding to the arc (i, j) in G. 


Multiplying equations (5.142a) and (5.142b) by c. . and cj. 

1 J KJ 

respectively, we get 


I c. . y. . 
(i,j)^A "J 


^ o i 

(p,q)eAlT°) 


^pq ' 


where, for an (p, g) e A{T ), p » (i, j) e A-T° and g « 


r , it represents the relation (i, j) e [S^,' S^] . 


(5.143) 

(k, I) € 


Furthermore, since x^^ a 0 and > 0, the condition y^j 

is redundant for (i, j) e A-T° = (T^) as evident from the 

equation (5.142) . Similarly the condition y^^^ s is redundant 

for (fe, I) e r° = ^2 (r°) . 


Let us define 


" ^kl every (p, g) e A{T°) (5.144) 

where p « (i, j) e and g « (ft, I) e r°. 

Incorporating the above discussion in the formulation of 
(DWRIST) , we have the following result . 



Theorem 5.21 : 


The dual of WRIST is the following transportation 
problem on the cut -graph G(r°) : 


Minimize 


(p,g) eA{T^) 


^pq 


(5.145a) 


subject to 

^ o ^ ^77 every p « (i, j) e A-T° , (5.145b) 

(p.g)6A(r°) 

^ o ^tvT ^ every g « (k, I) e T°, (5.145c) 

(p,g)eA(r°) 

Xpq ^ 0 for every (p, g) € A[T°) , (5.145d) 

A. 

where s are defined by (5.144). 

Special case : Rectilinear Variance 


In this case, = b^j = 1. Hence the formulation of the 

dual DWRIST of WRIST becomes the following assignment problem. 


Minimize V 

{p,q) eA{T°) P^ P^ 


A. 

C X 


subject to 


o^^pq " ^ every p « (i, j) e A-T° , 


(p,g)eA(r^) 


(5.146a) 

(5.146b) 

f 

(5.146c) 


^ 0 
pq 


for every (p, g) e A(T°), 


where s are defined by (5.144). 


(5.146d) 



Chapter 6 


CONCLUDING REMARKS 

In this dissertation, we have studied three primal algorithms 
for the minimum cost flow problem and two types of cost 
perturbations . 

The primal algorithms that we consider are variants of well- 
known primal algorithms, the network simplex algorithm and the 
cycl® cancelling algorithm. Our variant of the network simplex 
algorithm chooses an arc having minimum cost-to-penalty ratio as 
the entering arc in each iteration; the penalty of an arc is one 
if it violates optimality conditions in the initial basis, 
otherwise, zero. Our cycle -cancel ling algorithm with capacity 
scaling augments repeatedly a flow along a negative cycle which 
reduces the residual capacity of an eligible arc with maximum 
residual capacity by a factor of at least two. Our cancel-and- 
share algorithm consists of repeatedly increasing the potentials 
by a sufficiently large amount on a subset of nodes and making the 
resulting admissible graph acyclic. 

Our primal network simplex algorithm runs in 0(A (m+n log n) 
time, where A is an upper bound on the sum of arc flows. The 
algorithm achieves the best time complexity for the network 
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simplex algorithm for the assignment problem and the shortest path 
problem. The cycle-cancelling algorithm with capacity scaling and 
the enhanced cancel -and- share algorithm run respectively in 0{m 
log U{m+n log n) time and in 0{nm log n min{ log (nC) , on log n}) 
time . 


One investigation that can be taken for further research is 
obtaining a strongly polynomial time implementation of the cycle- 
cancelling algorithm with capacity-scaling. An open question 
posed by Goldberg and Tar j an is whether cancel subroutine can be 
implemented in O (m logCn^/m)) time. If this question can be 
settled positively, then Goldberg and Tarjan's cancel -and- tighten 
algorithm and the cancel-and-share algorithm, proposed in this 
dissertation, will give one of the best complexity bound obtained 
for the minimum cost flow problem. The empirical behaviour of our 
algorithm can also be studied. 

Wg have also studied cost perturbation of an arc that 
pi c*£, 5 (jrves the optimality of a given solution. Our approach is 
.ippli cable to both the minimum cost flow problem and the separable 
fonvtjx cost flow problem. All cost perturbations are 

fhaj'acteri zed by arc tolerance intervals. Using reoptimization, 
wv developed an O(n^) algorithm that finds nonsingleton shortest 
pat ha between all pairs of nodes, which directly give tolerance 
iut^gvalB for all arcs. Since our approach eliminates the effects 
of degeneracy, efficient implementations of our algorithm will be 
uHGful in practice. 



In inverse network flow problems, we have studied the 
problems of finding a cost for which a given flow is optimal and 
whose variance is minimum. We have shown duals of these problems 
are the problems of finding certain normalized feasible 
(augmenting) flow directions. Duals of the inverse network flow 
problems with side constraints can be considered for further 


research. 
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